-- Logs begin at Tue 2022-07-12 18:06:52 UTC, end at Tue 2022-07-12 19:07:57 UTC. -- Jul 12 18:41:11.063973 dv-osbrick-849026-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 18:41:11.072710 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 18:41:11.075293 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 18:41:11 2022] *** Jul 12 18:41:11.075428 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 18:41:11.075534 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 18:41:11.075699 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: nodename: dv-osbrick-849026-1-ceph Jul 12 18:41:11.075699 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: machine: x86_64 Jul 12 18:41:11.075699 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: clock source: unix Jul 12 18:41:11.075699 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: pcre jit disabled Jul 12 18:41:11.075699 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: detected number of CPU cores: 4 Jul 12 18:41:11.075699 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: current working directory: / Jul 12 18:41:11.075699 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: detected binary path: /usr/bin/uwsgi-core Jul 12 18:41:11.075699 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: your processes number limit is 47680 Jul 12 18:41:11.075699 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: your memory page size is 4096 bytes Jul 12 18:41:11.076204 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: detected max file descriptor number: 2048 Jul 12 18:41:11.076204 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: lock engine: pthread robust mutexes Jul 12 18:41:11.076204 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: thunder lock: enabled Jul 12 18:41:11.076204 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 18:41:11.076204 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 18:41:11.124847 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: Python main interpreter initialized at 0x5591b04629c0 Jul 12 18:41:11.124847 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: python threads support enabled Jul 12 18:41:11.124847 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: your server socket listen backlog is limited to 100 connections Jul 12 18:41:11.124847 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: your mercy for graceful operations on workers is 90 seconds Jul 12 18:41:11.125177 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 18:41:11.125251 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: *** Operational MODE: preforking *** Jul 12 18:41:11.125531 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: *** uWSGI is running in multiple interpreter mode *** Jul 12 18:41:11.125531 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: spawned uWSGI master process (pid: 93664) Jul 12 18:41:11.125731 dv-osbrick-849026-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 12 18:41:11.126499 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: spawned uWSGI worker 1 (pid: 93675, cores: 1) Jul 12 18:41:11.126608 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: spawned uWSGI worker 2 (pid: 93676, cores: 1) Jul 12 18:41:11.126743 dv-osbrick-849026-1-ceph devstack@keystone.service[93664]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 18:41:16.778470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:41:16.778470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: from cryptography.utils import int_from_bytes Jul 12 18:41:16.779270 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:41:16.779270 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: from cryptography.utils import int_from_bytes Jul 12 18:41:16.779406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:41:16.779406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: from cryptography.utils import int_from_bytes Jul 12 18:41:16.779406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:41:16.779406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: from cryptography.utils import int_from_bytes Jul 12 18:41:16.827324 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:41:16.827510 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:41:16.827705 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] command line args: [] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:41:16.827879 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:41:16.828068 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:41:16.828160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:41:16.828254 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ================================================================================ {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:41:16.828337 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] command line args: [] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:41:16.828511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] admin_token = **** {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.828625 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:41:16.828759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] config_dir = [] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.828848 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ================================================================================ {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:41:16.828947 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.829030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] admin_token = **** {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.829131 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] config_source = [] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.829341 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] debug = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.829434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] config_dir = [] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.829547 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.829799 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.829799 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] config_source = [] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.829906 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.829974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] debug = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.830115 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.830216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.830352 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.830455 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.830561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.830663 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.830787 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] list_limit = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.831397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.831504 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] log_config_append = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.831666 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.831792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.831896 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] log_dir = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.832012 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] log_file = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.832209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] list_limit = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.832346 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.832502 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] log_config_append = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.832633 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.832754 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.832869 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.833009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.833129 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] log_dir = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.833241 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.833389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] log_file = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.833511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.833631 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.833750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.833863 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.834018 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.834138 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.834296 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.834420 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.834533 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.834644 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.834758 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.834882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.835002 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.835115 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.835241 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.835354 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.835477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.835583 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.835738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.835966 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.836096 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.836220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] publish_errors = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.836339 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.836452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.836570 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.836683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.836802 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.836922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.837035 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.837153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.837271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.837427 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.837550 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] standard_threads = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.837663 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.837775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.837892 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] publish_errors = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.838024 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.838149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.838263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.838381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.838559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] use_journal = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.838676 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.838794 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] use_json = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.838794 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] use_stderr = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.839019 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.839138 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] use_syslog = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.839262 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.839382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.839494 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] standard_threads = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.839606 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.839718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.839830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.839953 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.839953 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.840178 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.840296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] use_journal = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.840415 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.840528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] use_json = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.840528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] use_stderr = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.840739 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.840835 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] use_syslog = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.840930 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.841023 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:41:16.841124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.841227 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.841342 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.841453 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.841556 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.841661 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.841777 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.841909 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.842026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.842138 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.842251 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.842369 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.842489 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.842610 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.842725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.842846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.842959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.843071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.843190 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.843312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.843427 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.843550 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.843663 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.843786 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.843901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.844088 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.844204 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.844323 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.844436 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.844549 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.844667 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.844792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.844908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.845020 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.845020 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.845231 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.845363 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.845490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.845490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.845705 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.845818 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.845931 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.846042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.846163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.846277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.846393 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.846507 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.847240 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.847365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.847471 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.847589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.847703 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.847816 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.847928 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.848049 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.848170 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.848170 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.848382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.848501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.848621 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.848746 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.848876 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.848989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.849109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.849229 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.849372 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.849499 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.849614 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.849725 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.849838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.849950 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.850063 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.850246 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.850362 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.850474 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.850586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.850698 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.850811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.850931 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.851046 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.851164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.851278 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.851390 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.851508 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.851630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.851750 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.851864 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.851976 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.852088 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.852200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.852321 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.852436 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.852554 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.852668 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.852788 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.852901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.853021 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.853136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.853254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.853385 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.853502 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.853650 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.853778 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.853894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.854007 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.854119 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.854232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.854346 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.854467 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.854582 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.854701 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.854815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.854934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.855056 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.855186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.855301 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.855416 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.855540 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.855655 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.855768 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.855887 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.856010 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.856129 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.856250 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.856364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.856491 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.856607 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.856720 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.856841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.856962 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.857077 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.857190 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.857365 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.857496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.857613 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.857727 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.857839 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.857953 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.858065 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.858187 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.858302 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.858415 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.858529 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.858739 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.858859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.858984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.859099 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.859212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.859332 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.859446 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.859565 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.859692 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.860287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.860406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.860505 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.860602 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.860698 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.860698 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.860888 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.860984 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.861081 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.861177 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.861274 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.861408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.861516 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.861614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.861710 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.861814 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.861911 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.862086 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.862193 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.862303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.862408 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.862505 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.862601 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.862715 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.862823 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.862943 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.863042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.863139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.863235 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.863331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.863428 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.863531 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.863638 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.863736 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.863834 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.863931 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.864027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.864131 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.864229 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.864325 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.864421 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.864516 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.864612 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.864716 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.864815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.864912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.865008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] auth.external = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.865104 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.865209 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.865370 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.865487 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.865602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.865716 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.865829 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.865960 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] auth.password = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.866103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] auth.external = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.866231 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] auth.token = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.866347 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.866469 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.866588 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.866702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.866816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.866939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.867054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] auth.password = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.867168 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.867282 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] auth.token = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.867395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.867516 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.867639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.867754 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.867864 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.867962 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.868075 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] credential.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.868187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.868312 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.868428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.868542 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.868656 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.868769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.868882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.869004 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.869120 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] credential.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.869234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.869363 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.869478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.869592 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.869719 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.869835 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.869954 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.870070 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.870184 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.870299 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.870299 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.870522 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.870636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.870750 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.870864 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.870977 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.871098 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.871222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.871338 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.871452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.871571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.871687 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.871809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.871925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] federation.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.872038 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.872159 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.872274 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.872388 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.872510 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.872625 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.872739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] federation.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.872853 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.872966 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.873080 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.873203 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.873332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.873448 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.873562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.873677 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.873791 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.873918 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.874034 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.874149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.874283 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.874422 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.874543 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.874667 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.874782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.874897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.875011 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.875124 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.875238 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.875426 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.875544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.875659 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.875773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.875895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.876019 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.876135 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.876250 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.876366 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.876490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.876607 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.876729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.876845 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.876959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.877073 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.877186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.877328 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.877454 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.877560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.877660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.877757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.877854 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.877950 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.878061 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.878161 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.878161 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.878342 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.878440 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.878537 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.878642 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.878741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.878838 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.878934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879127 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879127 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879412 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879509 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879509 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879687 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879898 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.879995 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.880092 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.880187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.880284 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.880394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.880531 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.880646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.880760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.880874 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.880988 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.881109 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.881224 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.881354 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.881354 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.881570 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.881683 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.881809 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.881925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.882038 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.882152 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.882264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.882378 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.882500 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.882622 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.882738 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.882851 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.882964 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.883077 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.883199 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.883314 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.883429 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.884071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.884191 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.884317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.884434 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.884548 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.884663 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.884778 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.884892 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.885015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.885131 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.885246 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.885372 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.885496 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.885612 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.885739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.885857 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.885971 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.886085 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.886199 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.886314 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.886436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.886556 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.886670 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.886785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.886908 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.887023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.887146 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.887262 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.887383 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.887498 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.887612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.887735 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.887850 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.887966 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.888079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.888193 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.888307 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.888429 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.888544 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.888659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.888772 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.888887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.889002 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.889125 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.889240 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.889406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.889522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.889637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.889751 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.889878 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.889996 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.890110 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.890224 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.890224 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.890437 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.890560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.890676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.890790 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.890904 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.891018 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.891133 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.891255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.891371 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.891484 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.891598 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.891712 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.891827 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.891950 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.892065 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.892180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.892295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.892409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.892523 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.892645 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.892760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.892874 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.892988 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.893102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.893217 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.893355 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.893980 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.894095 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.894269 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.894462 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.894644 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.894821 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.895010 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.895196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.895395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.895585 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.895787 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.895993 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.896183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.896372 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.896565 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.896747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.896920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.897116 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.897407 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.897605 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.897798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] resource.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.897989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] resource.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.898181 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.898390 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.898584 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.898766 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.898931 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.899145 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.899322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.899514 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.899678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.899839 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.900007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.900173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.900341 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.900612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.900798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.900974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.901134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.901330 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.901502 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] role.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.901699 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] role.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.901865 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] role.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.902021 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] role.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.902176 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.902338 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.902505 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.902687 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.902863 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.903029 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.903202 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.903376 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.903557 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.903757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.903946 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.904122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.904298 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.904481 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.904675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.904854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.905011 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.905174 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.905410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.905583 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.905583 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.905939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.906120 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.906553 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.906694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.906813 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.906938 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.907054 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.907170 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.907284 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.907398 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.907513 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.907636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.907753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.907870 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.907984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.908099 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.908214 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.908338 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.908454 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.908569 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.908691 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.908807 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.908922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.909078 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.909708 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.909826 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.909942 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.910056 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.910171 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.910304 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.910422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.910536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.910651 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.910765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.910888 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.911006 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.911121 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.911236 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.911351 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.911466 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.911589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.911704 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.911819 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.911933 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.912082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.912200 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] token.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.912323 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] token.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.912440 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.912554 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.912669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.912783 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.912897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.913020 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.913020 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.913238 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.913396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.913512 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.913627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.913767 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.913948 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.914066 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.914181 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.914296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.914410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.914533 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.914649 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.914763 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.914878 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.914992 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.915106 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.915230 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.915346 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.915461 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.915575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.915689 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.915803 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.915926 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.916043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.916157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.916272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.916386 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.916500 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.connection = **** {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.916631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.connection = **** {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.916759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.916883 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.917010 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.917127 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.917242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.917372 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.917486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.917600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.917600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.917830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.917945 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.918059 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.918173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.918289 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.918455 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.918575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.918689 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.918804 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.918918 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.919031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.919154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.919270 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.919386 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.919500 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.919614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.919728 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.919851 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.919967 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.920081 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.920196 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.920309 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.920425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.920547 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.920664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.920779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.920779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:41:16.920995 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:41:16.920995 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93676) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:41:16.945051 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.945295 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.945409 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.945524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.945648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.945878 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.953842 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.954252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.982444 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.982674 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.982775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:16.982989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.034793 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.035157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.084974 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.085204 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.085521 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.085753 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.149685 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.149847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.149935 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.150074 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.150160 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.150292 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.150374 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.150505 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.150596 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.150716 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.150797 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.150925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.173753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.173986 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.174070 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.174218 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.174300 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.174446 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.174537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.174697 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.174783 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.174916 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.174997 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.175129 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.175310 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.175392 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.188719 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.189952 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.201876 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.202102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.202246 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.202330 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.202481 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.202564 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.202706 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.202789 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.202922 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.203003 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.203130 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93675) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.203213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.203345 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.203562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93676) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:41:17.220597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.220800 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:41:17.220883 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.221074 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:41:17.221157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.221335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:41:17.221419 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.221639 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.221720 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:41:17.221898 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.221982 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.222150 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.222230 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.222397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.222486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.222687 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.233238 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.233540 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.233652 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.233801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.233927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.234076 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.234195 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.234476 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.242110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.242600 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.245361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.245636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.245894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.245976 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.246174 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.246257 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.246458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.246567 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.246737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.246833 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.247082 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.247162 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.247356 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.247438 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.247621 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.247711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.247886 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.247967 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.248146 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.248226 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.248420 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.248690 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.275389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.276136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.277118 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.277432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.277776 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.278058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.282925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.283197 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.283470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.283588 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.283866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.284183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.290971 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.291208 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.293913 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.294196 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.296076 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.296357 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.296634 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.296913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.297184 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.297485 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.297753 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.298021 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.299119 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.299406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.299713 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.299994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.300269 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.300543 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.300814 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.301083 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.317106 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.317404 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.320342 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.320621 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.321963 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.325204 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.325588 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.325876 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.328894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.329189 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.330810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.334785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.335016 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.338456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.338771 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.339065 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.339350 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.339629 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.339931 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.340207 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.342212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.342517 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.342801 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.343142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.343473 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.343766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.358993 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.359287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.359640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.359901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.362801 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.363091 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.363451 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.363719 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.367742 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.369463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.369736 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.371597 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.372748 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.373020 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.373302 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.373385 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.373592 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.373686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.373884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.376648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.376928 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.377220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.377535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.378370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.387669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.387945 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.388221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.388501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.388789 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.389060 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.389357 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.391734 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.392014 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.392298 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.392579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.392865 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.393140 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.393974 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.407943 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.411227 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.414129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.414531 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.416124 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.417447 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.417757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.418030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.418313 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.420772 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.422408 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.424051 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.424333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.425136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.426226 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.427821 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.431063 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.431345 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.431621 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.431892 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.432576 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.434229 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.437485 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.437771 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.438053 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.438328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.442553 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.442838 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.443113 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.450965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93675) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.451240 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.451349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.451521 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.451643 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.451789 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.451947 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.452081 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.452327 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.452600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.452862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.453125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.453422 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.453695 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.453961 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.454218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.454468 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93675) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.460228 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93676) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:41:17.460511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.460802 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.461079 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.461380 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.461657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.461931 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.462207 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.462488 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.462765 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.463052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.463322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.463586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.463847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93676) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:41:17.492524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591b04629c0 pid: 93675 (default app) Jul 12 18:41:17.495877 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8c77-b232-4902-bc46-17c207398a07 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:17.496170 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8c77-b232-4902-bc46-17c207398a07 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:17.496450 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8c77-b232-4902-bc46-17c207398a07 None None] PATH_INFO: `/v3` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:17.501110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Tue Jul 12 18:41:17 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:17.502206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591b04629c0 pid: 93676 (default app) Jul 12 18:41:25.391601 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd1e43-f4ec-4951-bb9b-7027ec36dc5b None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:25.392166 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd1e43-f4ec-4951-bb9b-7027ec36dc5b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:25.392166 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd1e43-f4ec-4951-bb9b-7027ec36dc5b None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:25.393577 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:41:25.401695 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:25.402109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:25.402258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:25.476419 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: INFO dbcounter [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] Registered counter for database keystone Jul 12 18:41:25.497227 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG oslo_db.sqlalchemy.engines [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93676) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:41:25.503910 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writer thread running {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:41:25.680969 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG passlib.handlers.bcrypt [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93676) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 18:41:25.681345 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG passlib.handlers.bcrypt [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93676) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 18:41:25.735989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:25.738171 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:25.858776 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 18:41:26.017026 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd1e43-f4ec-4951-bb9b-7027ec36dc5b None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:26.096484 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: INFO dbcounter [None req-8fcd1e43-f4ec-4951-bb9b-7027ec36dc5b None None] Registered counter for database keystone Jul 12 18:41:26.115313 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG oslo_db.sqlalchemy.engines [None req-8fcd1e43-f4ec-4951-bb9b-7027ec36dc5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:41:26.121550 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writer thread running {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:41:26.238896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd1e43-f4ec-4951-bb9b-7027ec36dc5b None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:26.243165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e6b3d9-296a-46ed-852c-3898bce67444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:26.243815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6b3d9-296a-46ed-852c-3898bce67444 admin admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:26.244096 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6b3d9-296a-46ed-852c-3898bce67444 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:26.244368 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e6b3d9-296a-46ed-852c-3898bce67444 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:26.252278 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6b3d9-296a-46ed-852c-3898bce67444 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:26.303137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: WARNING keystone.common.rbac_enforcer.enforcer [None req-44e6b3d9-296a-46ed-852c-3898bce67444 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 18:41:26.303427 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e6b3d9-296a-46ed-852c-3898bce67444 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:26.312663 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Jul 12 18:41:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:41:26.319885 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:26.336384 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a22ba-b009-4502-929d-f837ebf7a7d0 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:26.340825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690e8cf-b809-4c9f-b725-88609a55a6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:26.342310 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690e8cf-b809-4c9f-b725-88609a55a6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:26.342310 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690e8cf-b809-4c9f-b725-88609a55a6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:26.342513 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690e8cf-b809-4c9f-b725-88609a55a6a0 admin admin] PATH_INFO: `/v3/projects/50ac8b5806ca4cab991abf52d2b9928f` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:26.344016 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690e8cf-b809-4c9f-b725-88609a55a6a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=50ac8b5806ca4cab991abf52d2b9928f)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:26.396264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b690e8cf-b809-4c9f-b725-88609a55a6a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 18:41:26.396611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690e8cf-b809-4c9f-b725-88609a55a6a0 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:26.401133 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 2/5] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Jul 12 18:41:26 2022] GET /identity/v3/projects/50ac8b5806ca4cab991abf52d2b9928f => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:28.602175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7313-29ef-425b-b506-7596bbd164fa None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:28.602710 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7313-29ef-425b-b506-7596bbd164fa None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:28.602710 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7313-29ef-425b-b506-7596bbd164fa None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:28.606853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 4/6] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:28.612760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb66dd-9913-4437-92dc-15e45f004e28 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:28.613145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb66dd-9913-4437-92dc-15e45f004e28 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:28.613333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdb66dd-9913-4437-92dc-15e45f004e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:28.631745 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-8fdb66dd-9913-4437-92dc-15e45f004e28 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:28.633274 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-8fdb66dd-9913-4437-92dc-15e45f004e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:28.640956 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 18:41:28.664802 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b7313-29ef-425b-b506-7596bbd164fa None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:28.677192 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b7313-29ef-425b-b506-7596bbd164fa None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:28.681358 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd98b40-7adb-421d-a9c5-958c846380d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:28.681978 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd98b40-7adb-421d-a9c5-958c846380d0 admin admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:28.682260 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd98b40-7adb-421d-a9c5-958c846380d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:28.682536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd98b40-7adb-421d-a9c5-958c846380d0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:28.690079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd98b40-7adb-421d-a9c5-958c846380d0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:28.691831 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd98b40-7adb-421d-a9c5-958c846380d0 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:28.700702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Jul 12 18:41:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:41:28.706618 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb66dd-9913-4437-92dc-15e45f004e28 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:28.715626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdb66dd-9913-4437-92dc-15e45f004e28 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:28.719979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b862b92-3a35-47f4-862d-04a908fe6201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:28.720837 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b862b92-3a35-47f4-862d-04a908fe6201 admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:28.721793 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b862b92-3a35-47f4-862d-04a908fe6201 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:28.722079 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b862b92-3a35-47f4-862d-04a908fe6201 admin admin] PATH_INFO: `/v3/users/ca16bce227ff43aa8e414592d2c86bfd` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:28.723470 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b862b92-3a35-47f4-862d-04a908fe6201 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca16bce227ff43aa8e414592d2c86bfd)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:28.725312 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b862b92-3a35-47f4-862d-04a908fe6201 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:28.726878 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 4/9] 10.222.0.16 () {56 vars in 1198 bytes} [Tue Jul 12 18:41:28 2022] GET /identity/v3/users/ca16bce227ff43aa8e414592d2c86bfd => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:31.002687 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48782-8a4f-4a89-a919-b9b6acaf907b None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.003210 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48782-8a4f-4a89-a919-b9b6acaf907b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.003210 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed48782-8a4f-4a89-a919-b9b6acaf907b None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.004594 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:31.009658 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6e977-1abc-4a17-aedb-b540a9135c76 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.010053 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6e977-1abc-4a17-aedb-b540a9135c76 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.010225 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6e977-1abc-4a17-aedb-b540a9135c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.019690 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f4e2-1de6-444a-bd09-75f2e1bcc037 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.019979 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f4e2-1de6-444a-bd09-75f2e1bcc037 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.020259 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5370f4e2-1de6-444a-bd09-75f2e1bcc037 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.021622 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 7/11] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:41:31.026611 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b573d-cda2-4ec6-9dee-21e169ecf2d9 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.026904 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b573d-cda2-4ec6-9dee-21e169ecf2d9 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.027187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b573d-cda2-4ec6-9dee-21e169ecf2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.027615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-b9d6e977-1abc-4a17-aedb-b540a9135c76 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:31.028895 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-b9d6e977-1abc-4a17-aedb-b540a9135c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:31.067177 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG passlib.handlers.bcrypt [None req-314b573d-cda2-4ec6-9dee-21e169ecf2d9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93675) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 18:41:31.067598 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG passlib.handlers.bcrypt [None req-314b573d-cda2-4ec6-9dee-21e169ecf2d9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93675) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 18:41:31.108154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:31.113519 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-314b573d-cda2-4ec6-9dee-21e169ecf2d9 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:31.115125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-314b573d-cda2-4ec6-9dee-21e169ecf2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:31.132709 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6e977-1abc-4a17-aedb-b540a9135c76 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.156064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:31.214787 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:41:31.241304 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b573d-cda2-4ec6-9dee-21e169ecf2d9 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.345793 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b573d-cda2-4ec6-9dee-21e169ecf2d9 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.348101 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:31.350532 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6e977-1abc-4a17-aedb-b540a9135c76 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.387412 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a596fbe-1fb2-4b5c-aefd-3fb73b94cb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.388130 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a596fbe-1fb2-4b5c-aefd-3fb73b94cb6b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.388417 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a596fbe-1fb2-4b5c-aefd-3fb73b94cb6b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.388701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a596fbe-1fb2-4b5c-aefd-3fb73b94cb6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.389109 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236bb50-4f2f-4d4a-8ead-5862e4805015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.390058 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236bb50-4f2f-4d4a-8ead-5862e4805015 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.390343 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236bb50-4f2f-4d4a-8ead-5862e4805015 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.390619 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236bb50-4f2f-4d4a-8ead-5862e4805015 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.400776 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a596fbe-1fb2-4b5c-aefd-3fb73b94cb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-2a596fbe-1fb2-4b5c-aefd-3fb73b94cb6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:31.412308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:31.413203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:31.414096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 6/14] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:41:31.419400 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a596fbe-1fb2-4b5c-aefd-3fb73b94cb6b None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.458263 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236bb50-4f2f-4d4a-8ead-5862e4805015 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.459777 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236bb50-4f2f-4d4a-8ead-5862e4805015 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.501774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:31.521548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a596fbe-1fb2-4b5c-aefd-3fb73b94cb6b None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.555055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39476834-5f24-43c2-805a-70a46976ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.555719 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39476834-5f24-43c2-805a-70a46976ac8f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.555899 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 9/15] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:41:31.555998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39476834-5f24-43c2-805a-70a46976ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.556277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39476834-5f24-43c2-805a-70a46976ac8f None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.557028 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39476834-5f24-43c2-805a-70a46976ac8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:31.557370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39476834-5f24-43c2-805a-70a46976ac8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.558774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39476834-5f24-43c2-805a-70a46976ac8f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.561496 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236bb50-4f2f-4d4a-8ead-5862e4805015 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.564109 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:31.571616 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 7/16] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:41:31.576903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39476834-5f24-43c2-805a-70a46976ac8f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.660230 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236bb50-4f2f-4d4a-8ead-5862e4805015 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.676152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39476834-5f24-43c2-805a-70a46976ac8f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.694091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b014c68-6ef7-4997-b6ac-240a59ad5ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.694877 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b014c68-6ef7-4997-b6ac-240a59ad5ed5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.695160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b014c68-6ef7-4997-b6ac-240a59ad5ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.695437 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b014c68-6ef7-4997-b6ac-240a59ad5ed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.710218 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2058d-5741-44bb-96e0-7766b3a43359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.711089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2058d-5741-44bb-96e0-7766b3a43359 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.711385 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2058d-5741-44bb-96e0-7766b3a43359 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.711656 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2058d-5741-44bb-96e0-7766b3a43359 None admin] PATH_INFO: `/v3/users/ca16bce227ff43aa8e414592d2c86bfd` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.712845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2058d-5741-44bb-96e0-7766b3a43359 None admin] RBAC: Authorizing `identity:get_user(user_id=ca16bce227ff43aa8e414592d2c86bfd)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.713543 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b014c68-6ef7-4997-b6ac-240a59ad5ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.714329 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2058d-5741-44bb-96e0-7766b3a43359 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.714982 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b014c68-6ef7-4997-b6ac-240a59ad5ed5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.716214 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 8/17] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/users/ca16bce227ff43aa8e414592d2c86bfd => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:41:31.721359 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2058d-5741-44bb-96e0-7766b3a43359 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.735929 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-8b014c68-6ef7-4997-b6ac-240a59ad5ed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:41:31.740463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:31.741600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:31.742702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:41:31.742702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:41:31.742702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:41:31.742702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:41:31.742702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:41:31.747424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b014c68-6ef7-4997-b6ac-240a59ad5ed5 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.828208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2058d-5741-44bb-96e0-7766b3a43359 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.863513 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54006049-c5db-40d5-967c-2860886a3a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.864320 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54006049-c5db-40d5-967c-2860886a3a5f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.864601 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54006049-c5db-40d5-967c-2860886a3a5f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.864872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54006049-c5db-40d5-967c-2860886a3a5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.866907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54006049-c5db-40d5-967c-2860886a3a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.868447 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54006049-c5db-40d5-967c-2860886a3a5f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:31.870230 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:41:31.876023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54006049-c5db-40d5-967c-2860886a3a5f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:31.909930 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:31.953832 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b014c68-6ef7-4997-b6ac-240a59ad5ed5 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.957362 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:31.976699 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54006049-c5db-40d5-967c-2860886a3a5f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:31.986186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e898d-e3e6-4e81-bcb2-56a93d09d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:31.987368 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e898d-e3e6-4e81-bcb2-56a93d09d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:31.987643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e898d-e3e6-4e81-bcb2-56a93d09d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:31.987915 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e898d-e3e6-4e81-bcb2-56a93d09d7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:31.988632 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e898d-e3e6-4e81-bcb2-56a93d09d7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:31.988933 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e898d-e3e6-4e81-bcb2-56a93d09d7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:31.990347 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e898d-e3e6-4e81-bcb2-56a93d09d7d8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:32.007791 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:41:32.011963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42207ae-9ce7-42a3-a42c-db3d755902da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:32.012639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42207ae-9ce7-42a3-a42c-db3d755902da None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:32.012929 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42207ae-9ce7-42a3-a42c-db3d755902da None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:32.013206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42207ae-9ce7-42a3-a42c-db3d755902da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:32.014082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42207ae-9ce7-42a3-a42c-db3d755902da None admin] RBAC: Adding query filter params (role.id=948b82ff28c547e78755c196cddfdd0e, scope.domain.id=default, user.id=ca16bce227ff43aa8e414592d2c86bfd) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:32.014395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42207ae-9ce7-42a3-a42c-db3d755902da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:32.015888 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42207ae-9ce7-42a3-a42c-db3d755902da None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:32.023865 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Jul 12 18:41:31 2022] GET /identity/v3/role_assignments?user.id=ca16bce227ff43aa8e414592d2c86bfd&scope.domain.id=default&role.id=948b82ff28c547e78755c196cddfdd0e => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:41:34.607432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec2ab5-8796-414a-b8b8-9da1c95b03f2 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:34.608547 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec2ab5-8796-414a-b8b8-9da1c95b03f2 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:34.609025 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec2ab5-8796-414a-b8b8-9da1c95b03f2 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:34.610941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:34.616989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81673a94-3fe1-4b0f-a010-576843111fc8 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:34.617506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81673a94-3fe1-4b0f-a010-576843111fc8 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:34.617605 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81673a94-3fe1-4b0f-a010-576843111fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:34.642629 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-81673a94-3fe1-4b0f-a010-576843111fc8 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:34.643885 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-81673a94-3fe1-4b0f-a010-576843111fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:34.746555 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:34.780650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fcb20-d9f2-43f6-8ed7-b8f306267cf3 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:34.781588 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fcb20-d9f2-43f6-8ed7-b8f306267cf3 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:34.782070 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fcb20-d9f2-43f6-8ed7-b8f306267cf3 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:34.784464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:34.786533 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81673a94-3fe1-4b0f-a010-576843111fc8 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:34.790330 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52544b9-0769-469e-be2c-daa06f7d682e None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:34.790853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52544b9-0769-469e-be2c-daa06f7d682e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:34.791340 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52544b9-0769-469e-be2c-daa06f7d682e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:34.817800 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-f52544b9-0769-469e-be2c-daa06f7d682e None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:34.819343 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-f52544b9-0769-469e-be2c-daa06f7d682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:34.905395 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 14/25] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:34.925277 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b05e-5c40-4b04-a5ff-85774256e78d None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:34.925818 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b05e-5c40-4b04-a5ff-85774256e78d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:34.926254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b05e-5c40-4b04-a5ff-85774256e78d None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:34.929259 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 15/26] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:34.934241 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397d2e-18ba-4925-b9c8-921561929cea None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:34.934802 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397d2e-18ba-4925-b9c8-921561929cea None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:34.935235 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09397d2e-18ba-4925-b9c8-921561929cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:34.943638 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:34.953948 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-09397d2e-18ba-4925-b9c8-921561929cea None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:34.955899 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-09397d2e-18ba-4925-b9c8-921561929cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:35.000058 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:35.011476 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81673a94-3fe1-4b0f-a010-576843111fc8 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:35.033473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 16/27] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:41:35.035031 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09397d2e-18ba-4925-b9c8-921561929cea None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:35.110210 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb20a5-a288-41a5-9899-f2010781a2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:35.111201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb20a5-a288-41a5-9899-f2010781a2ad None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:35.111571 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb20a5-a288-41a5-9899-f2010781a2ad None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:35.111858 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb20a5-a288-41a5-9899-f2010781a2ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:35.146289 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb20a5-a288-41a5-9899-f2010781a2ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-80cb20a5-a288-41a5-9899-f2010781a2ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:35.162072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:35.163111 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:35.163975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 12/28] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:41:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:41:35.164780 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb20a5-a288-41a5-9899-f2010781a2ad None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:35.169027 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09397d2e-18ba-4925-b9c8-921561929cea None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:35.206164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5427b-ac8d-4d6b-8a85-ebd26b5f41d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:35.207100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5427b-ac8d-4d6b-8a85-ebd26b5f41d7 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:35.207521 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5427b-ac8d-4d6b-8a85-ebd26b5f41d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:35.207941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5427b-ac8d-4d6b-8a85-ebd26b5f41d7 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:35.208810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5427b-ac8d-4d6b-8a85-ebd26b5f41d7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:35.210327 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e5427b-ac8d-4d6b-8a85-ebd26b5f41d7 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:35.326391 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb20a5-a288-41a5-9899-f2010781a2ad None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:35.361082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb700b-8606-458b-9430-c3e2aad98509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:35.362142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb700b-8606-458b-9430-c3e2aad98509 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:35.362562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb700b-8606-458b-9430-c3e2aad98509 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:35.362998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb700b-8606-458b-9430-c3e2aad98509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:35.365153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:35.375074 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb700b-8606-458b-9430-c3e2aad98509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:35.376229 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 17/29] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Jul 12 18:41:35 2022] POST /identity/v3/roles => generated 219 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:35.377679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb700b-8606-458b-9430-c3e2aad98509 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:35.384851 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5427b-ac8d-4d6b-8a85-ebd26b5f41d7 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-cacb700b-8606-458b-9430-c3e2aad98509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:41:35.421861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:35.422717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:35.423534 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:41:35.423534 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:41:35.423534 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:41:35.423534 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:35.427937 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 13/30] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:35.430463 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8ba29-8a85-4944-8756-0a28c6d7783c None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:35.431934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8ba29-8a85-4944-8756-0a28c6d7783c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:35.432558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8ba29-8a85-4944-8756-0a28c6d7783c None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:35.438482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 14/31] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:35.439372 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8ba29-8a85-4944-8756-0a28c6d7783c None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:35.478354 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:35.568138 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5427b-ac8d-4d6b-8a85-ebd26b5f41d7 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:35.606215 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8ba29-8a85-4944-8756-0a28c6d7783c None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:35.609486 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d6e7d-0ca1-4730-a30f-7e7dbff21eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:35.610167 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d6e7d-0ca1-4730-a30f-7e7dbff21eea None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:35.610450 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d6e7d-0ca1-4730-a30f-7e7dbff21eea None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:35.610726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d6e7d-0ca1-4730-a30f-7e7dbff21eea None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:35.612001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d6e7d-0ca1-4730-a30f-7e7dbff21eea None admin] RBAC: Adding query filter params (name=admin) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:35.612309 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d6e7d-0ca1-4730-a30f-7e7dbff21eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:35.613881 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d6e7d-0ca1-4730-a30f-7e7dbff21eea None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:35.628593 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 18/32] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:35.629994 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71cc4b-286f-43a6-a6e3-5f05b0aca400 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:35.630345 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71cc4b-286f-43a6-a6e3-5f05b0aca400 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:35.630626 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71cc4b-286f-43a6-a6e3-5f05b0aca400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:35.650420 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-dd71cc4b-286f-43a6-a6e3-5f05b0aca400 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:35.651937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-dd71cc4b-286f-43a6-a6e3-5f05b0aca400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:35.660840 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec8ed-bc7b-47d0-a0be-15c1853049e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:35.662542 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec8ed-bc7b-47d0-a0be-15c1853049e4 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:35.663131 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec8ed-bc7b-47d0-a0be-15c1853049e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:35.663913 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec8ed-bc7b-47d0-a0be-15c1853049e4 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:35.665188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dec8ed-bc7b-47d0-a0be-15c1853049e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:35.665967 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dec8ed-bc7b-47d0-a0be-15c1853049e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:35.668308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dec8ed-bc7b-47d0-a0be-15c1853049e4 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:35.700769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 15/33] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:35.701645 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec8ed-bc7b-47d0-a0be-15c1853049e4 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:35.734824 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 19/34] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:35.736094 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71cc4b-286f-43a6-a6e3-5f05b0aca400 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:35.758146 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:35.785372 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:35.821328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec8ed-bc7b-47d0-a0be-15c1853049e4 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:35.858978 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bdd10-0939-44de-b478-0f9938a3bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:35.859824 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bdd10-0939-44de-b478-0f9938a3bb9f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:35.860155 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bdd10-0939-44de-b478-0f9938a3bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:35.860429 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1bdd10-0939-44de-b478-0f9938a3bb9f None admin] PATH_INFO: `/v3/users/ca16bce227ff43aa8e414592d2c86bfd` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:35.863845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bdd10-0939-44de-b478-0f9938a3bb9f None admin] RBAC: Authorizing `identity:get_user(user_id=ca16bce227ff43aa8e414592d2c86bfd)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:35.864506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1bdd10-0939-44de-b478-0f9938a3bb9f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:35.866426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 16/35] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:35 2022] GET /identity/v3/users/ca16bce227ff43aa8e414592d2c86bfd => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:35.869397 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bdd10-0939-44de-b478-0f9938a3bb9f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:35.889844 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71cc4b-286f-43a6-a6e3-5f05b0aca400 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:35.932086 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c9794-59af-47e8-a7b1-befe5186616a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:35.932784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c9794-59af-47e8-a7b1-befe5186616a None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:35.933067 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c9794-59af-47e8-a7b1-befe5186616a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:35.933374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c9794-59af-47e8-a7b1-befe5186616a None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:35.934343 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c9794-59af-47e8-a7b1-befe5186616a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:35.936300 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c9794-59af-47e8-a7b1-befe5186616a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:35.981407 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 20/36] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Jul 12 18:41:35 2022] POST /identity/v3/projects => generated 301 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:35.981407 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c9794-59af-47e8-a7b1-befe5186616a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:36.049318 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1bdd10-0939-44de-b478-0f9938a3bb9f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:36.093187 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:36.137661 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae7e5c-6982-46a2-9729-7f7d06756fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:36.141822 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae7e5c-6982-46a2-9729-7f7d06756fe3 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:36.142534 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae7e5c-6982-46a2-9729-7f7d06756fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:36.143567 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae7e5c-6982-46a2-9729-7f7d06756fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:36.144552 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae7e5c-6982-46a2-9729-7f7d06756fe3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:36.149575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae7e5c-6982-46a2-9729-7f7d06756fe3 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:36.174874 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:36.194463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c9794-59af-47e8-a7b1-befe5186616a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:36.234457 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815d1b0-ae10-4b8a-a60c-a3b175809fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:36.235612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815d1b0-ae10-4b8a-a60c-a3b175809fe5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:36.236097 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815d1b0-ae10-4b8a-a60c-a3b175809fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:36.237256 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815d1b0-ae10-4b8a-a60c-a3b175809fe5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:36.238793 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815d1b0-ae10-4b8a-a60c-a3b175809fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:36.240630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815d1b0-ae10-4b8a-a60c-a3b175809fe5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:36.242662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 21/37] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:36.244277 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae935f-9552-4b69-ad5c-b00a26489a22 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:36.244780 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae935f-9552-4b69-ad5c-b00a26489a22 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:36.245299 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae935f-9552-4b69-ad5c-b00a26489a22 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:36.246913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 22/38] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:36.251464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae935f-9552-4b69-ad5c-b00a26489a22 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:36.314326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 17/39] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Jul 12 18:41:35 2022] POST /identity/v3/roles => generated 225 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:36.316761 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fcc59-2717-4ef4-a996-7b16a566561c None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:36.317048 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fcc59-2717-4ef4-a996-7b16a566561c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:36.317420 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088fcc59-2717-4ef4-a996-7b16a566561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:36.337732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-088fcc59-2717-4ef4-a996-7b16a566561c None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:36.339375 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-088fcc59-2717-4ef4-a996-7b16a566561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:36.398231 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae935f-9552-4b69-ad5c-b00a26489a22 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:36.440549 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 18/40] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:36.453377 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c40c4-89cb-4572-9b58-c5bbb9ddfb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:36.453377 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c40c4-89cb-4572-9b58-c5bbb9ddfb64 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:36.453377 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c40c4-89cb-4572-9b58-c5bbb9ddfb64 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:36.453377 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c40c4-89cb-4572-9b58-c5bbb9ddfb64 None admin] PATH_INFO: `/v3/domains/default/users/ca16bce227ff43aa8e414592d2c86bfd/roles/948b82ff28c547e78755c196cddfdd0e` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:36.453743 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c40c4-89cb-4572-9b58-c5bbb9ddfb64 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ca16bce227ff43aa8e414592d2c86bfd, role_id=948b82ff28c547e78755c196cddfdd0e)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:36.453743 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c40c4-89cb-4572-9b58-c5bbb9ddfb64 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:36.470820 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fcc59-2717-4ef4-a996-7b16a566561c None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:36.475137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 23/41] 10.222.0.16 () {58 vars in 1361 bytes} [Tue Jul 12 18:41:36 2022] PUT /identity/v3/domains/default/users/ca16bce227ff43aa8e414592d2c86bfd/roles/948b82ff28c547e78755c196cddfdd0e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:41:36.506886 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372b830-b08a-417d-bbca-c919c10e389a None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:36.507241 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372b830-b08a-417d-bbca-c919c10e389a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:36.507693 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372b830-b08a-417d-bbca-c919c10e389a None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:36.509467 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 24/42] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:41:36.516495 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986f25-de0d-4d22-a9a3-04c95cee4a36 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:36.516886 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986f25-de0d-4d22-a9a3-04c95cee4a36 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:36.517307 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0986f25-de0d-4d22-a9a3-04c95cee4a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:36.544680 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-f0986f25-de0d-4d22-a9a3-04c95cee4a36 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:36.545980 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-f0986f25-de0d-4d22-a9a3-04c95cee4a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:36.548796 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:36.599988 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088fcc59-2717-4ef4-a996-7b16a566561c None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:36.603539 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:36.650813 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252cb24-d94c-46f9-bf8b-51b97350e3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:36.651252 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 25/43] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:41:36.651683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252cb24-d94c-46f9-bf8b-51b97350e3a6 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:36.651755 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252cb24-d94c-46f9-bf8b-51b97350e3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:36.652022 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252cb24-d94c-46f9-bf8b-51b97350e3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:36.652768 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252cb24-d94c-46f9-bf8b-51b97350e3a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:36.654964 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252cb24-d94c-46f9-bf8b-51b97350e3a6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:36.675234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 19/44] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Jul 12 18:41:36 2022] POST /identity/v3/roles => generated 223 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:36.681319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986f25-de0d-4d22-a9a3-04c95cee4a36 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:36.804580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0986f25-de0d-4d22-a9a3-04c95cee4a36 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:36.842210 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae92974-bad3-40ab-b3e7-67a2812ca2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:36.843116 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae92974-bad3-40ab-b3e7-67a2812ca2e5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:36.843472 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae92974-bad3-40ab-b3e7-67a2812ca2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:36.843820 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae92974-bad3-40ab-b3e7-67a2812ca2e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:36.845145 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae92974-bad3-40ab-b3e7-67a2812ca2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:36.847287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae92974-bad3-40ab-b3e7-67a2812ca2e5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:36.849020 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 26/45] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:36.854580 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252cb24-d94c-46f9-bf8b-51b97350e3a6 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:36.962388 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252cb24-d94c-46f9-bf8b-51b97350e3a6 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:36.995224 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab85382-4c03-4fef-9534-7edc6db0abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:36.995879 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab85382-4c03-4fef-9534-7edc6db0abf2 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:36.996160 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab85382-4c03-4fef-9534-7edc6db0abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:36.996434 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab85382-4c03-4fef-9534-7edc6db0abf2 None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:36.997148 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab85382-4c03-4fef-9534-7edc6db0abf2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:36.998626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab85382-4c03-4fef-9534-7edc6db0abf2 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:37.025108 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 20/46] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Jul 12 18:41:36 2022] POST /identity/v3/projects => generated 312 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:41:38.734094 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55bf6-b53a-41cf-80e7-95d4b374a273 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:38.734608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55bf6-b53a-41cf-80e7-95d4b374a273 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:38.734690 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b55bf6-b53a-41cf-80e7-95d4b374a273 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:38.736036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 27/47] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:38.741165 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29309d-69d5-4840-9a83-b8483e82321e None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:38.741619 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29309d-69d5-4840-9a83-b8483e82321e None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:38.741796 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29309d-69d5-4840-9a83-b8483e82321e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:38.758420 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-8d29309d-69d5-4840-9a83-b8483e82321e None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:38.759600 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-8d29309d-69d5-4840-9a83-b8483e82321e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:38.772929 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:38.828638 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 21/48] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:38.852963 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b55bf6-b53a-41cf-80e7-95d4b374a273 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:38.862361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:38.954506 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b55bf6-b53a-41cf-80e7-95d4b374a273 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:38.987246 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95169d4-a683-4421-a847-3903c17edd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:38.987959 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95169d4-a683-4421-a847-3903c17edd99 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:38.988238 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95169d4-a683-4421-a847-3903c17edd99 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:38.988509 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95169d4-a683-4421-a847-3903c17edd99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:38.999506 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95169d4-a683-4421-a847-3903c17edd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-f95169d4-a683-4421-a847-3903c17edd99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:39.008905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:39.009775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:41:39.010528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 28/49] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:39.015878 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29309d-69d5-4840-9a83-b8483e82321e None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.116455 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29309d-69d5-4840-9a83-b8483e82321e None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.151657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4aba28-bd67-4ee1-a7d0-acad669c6e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.152319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4aba28-bd67-4ee1-a7d0-acad669c6e62 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.152600 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4aba28-bd67-4ee1-a7d0-acad669c6e62 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.152875 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4aba28-bd67-4ee1-a7d0-acad669c6e62 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.153644 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4aba28-bd67-4ee1-a7d0-acad669c6e62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:39.153950 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4aba28-bd67-4ee1-a7d0-acad669c6e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.155325 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4aba28-bd67-4ee1-a7d0-acad669c6e62 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.163519 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 22/50] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:39.169147 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95169d4-a683-4421-a847-3903c17edd99 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.233130 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:39.241875 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a2f59-b658-4e9b-abe5-68f4c514b132 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.242103 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a2f59-b658-4e9b-abe5-68f4c514b132 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.242382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a2f59-b658-4e9b-abe5-68f4c514b132 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.243752 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 23/51] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:41:39.248423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bc9f9-5492-46c2-aea7-acb79ba6c969 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.248717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bc9f9-5492-46c2-aea7-acb79ba6c969 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.248998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bc9f9-5492-46c2-aea7-acb79ba6c969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.265714 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-235bc9f9-5492-46c2-aea7-acb79ba6c969 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:39.266916 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-235bc9f9-5492-46c2-aea7-acb79ba6c969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:39.268310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95169d4-a683-4421-a847-3903c17edd99 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.268853 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:39.301242 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11c03-f1ce-4832-a80b-5377deab39a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.302137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11c03-f1ce-4832-a80b-5377deab39a7 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.302414 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11c03-f1ce-4832-a80b-5377deab39a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.302683 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e11c03-f1ce-4832-a80b-5377deab39a7 None admin] PATH_INFO: `/v3/users/ca16bce227ff43aa8e414592d2c86bfd` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.303864 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e11c03-f1ce-4832-a80b-5377deab39a7 None admin] RBAC: Authorizing `identity:get_user(user_id=ca16bce227ff43aa8e414592d2c86bfd)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.305320 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e11c03-f1ce-4832-a80b-5377deab39a7 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.306935 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 29/52] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:39 2022] GET /identity/v3/users/ca16bce227ff43aa8e414592d2c86bfd => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:39.312221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11c03-f1ce-4832-a80b-5377deab39a7 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.344431 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 24/53] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:41:39.368585 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bc9f9-5492-46c2-aea7-acb79ba6c969 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.410239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e11c03-f1ce-4832-a80b-5377deab39a7 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.446031 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9db785-152e-423f-9f53-0c5891a19afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.447158 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db785-152e-423f-9f53-0c5891a19afd None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.447445 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db785-152e-423f-9f53-0c5891a19afd None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.447738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9db785-152e-423f-9f53-0c5891a19afd None admin] PATH_INFO: `/v3/domains/default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.450023 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9db785-152e-423f-9f53-0c5891a19afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.452411 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9db785-152e-423f-9f53-0c5891a19afd None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.454660 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 30/54] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:41:39.460710 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9db785-152e-423f-9f53-0c5891a19afd None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.463594 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:39.473209 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bc9f9-5492-46c2-aea7-acb79ba6c969 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.507127 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9ba7c-6b16-4d1e-982a-fcc1667a8460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.507847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9ba7c-6b16-4d1e-982a-fcc1667a8460 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.508126 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9ba7c-6b16-4d1e-982a-fcc1667a8460 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.508406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9ba7c-6b16-4d1e-982a-fcc1667a8460 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.509601 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9ba7c-6b16-4d1e-982a-fcc1667a8460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.511070 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9ba7c-6b16-4d1e-982a-fcc1667a8460 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.512691 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 25/55] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:41:39.518277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9ba7c-6b16-4d1e-982a-fcc1667a8460 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:39.526754 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:39.563957 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9db785-152e-423f-9f53-0c5891a19afd None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.596967 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdef3c-81ad-468c-8f6d-77670762e3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.597763 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdef3c-81ad-468c-8f6d-77670762e3d4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.598053 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdef3c-81ad-468c-8f6d-77670762e3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.598338 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdef3c-81ad-468c-8f6d-77670762e3d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.599163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdef3c-81ad-468c-8f6d-77670762e3d4 None admin] RBAC: Adding query filter params (role.id=948b82ff28c547e78755c196cddfdd0e, scope.domain.id=default, user.id=ca16bce227ff43aa8e414592d2c86bfd) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:39.599477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdef3c-81ad-468c-8f6d-77670762e3d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.600938 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdef3c-81ad-468c-8f6d-77670762e3d4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.608872 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 31/56] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Jul 12 18:41:39 2022] GET /identity/v3/role_assignments?user.id=ca16bce227ff43aa8e414592d2c86bfd&scope.domain.id=default&role.id=948b82ff28c547e78755c196cddfdd0e => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:41:39.623460 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9ba7c-6b16-4d1e-982a-fcc1667a8460 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:39.659571 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e52a95-a966-43d4-b0e6-f8beccc013db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:39.660244 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e52a95-a966-43d4-b0e6-f8beccc013db None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:39.660529 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e52a95-a966-43d4-b0e6-f8beccc013db None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:39.660805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e52a95-a966-43d4-b0e6-f8beccc013db None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:39.661566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e52a95-a966-43d4-b0e6-f8beccc013db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:39.663052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e52a95-a966-43d4-b0e6-f8beccc013db None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:39.694813 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 26/57] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Jul 12 18:41:39 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:41:41.918508 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b607127-9050-4ea1-9cef-0f6827bc2d87 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:41.918960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b607127-9050-4ea1-9cef-0f6827bc2d87 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:41.919070 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b607127-9050-4ea1-9cef-0f6827bc2d87 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:41.920606 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 32/58] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:41.925696 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711d6a8-0d44-497b-a7cc-36477b0da1ea None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:41.926054 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711d6a8-0d44-497b-a7cc-36477b0da1ea None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:41.926252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711d6a8-0d44-497b-a7cc-36477b0da1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:41.942981 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-1711d6a8-0d44-497b-a7cc-36477b0da1ea None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:41.944183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-1711d6a8-0d44-497b-a7cc-36477b0da1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:41.994964 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:42.009260 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 27/59] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:42.035334 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b607127-9050-4ea1-9cef-0f6827bc2d87 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:42.099501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:42.133531 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b607127-9050-4ea1-9cef-0f6827bc2d87 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:42.166141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349c100-1c8f-4177-98af-05360cb1a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:42.166906 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349c100-1c8f-4177-98af-05360cb1a91c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:42.167185 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349c100-1c8f-4177-98af-05360cb1a91c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:42.167461 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349c100-1c8f-4177-98af-05360cb1a91c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:42.168605 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349c100-1c8f-4177-98af-05360cb1a91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:42.170084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349c100-1c8f-4177-98af-05360cb1a91c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:42.171665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 33/60] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:42.177560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711d6a8-0d44-497b-a7cc-36477b0da1ea None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:42.272561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711d6a8-0d44-497b-a7cc-36477b0da1ea None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:42.304716 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ffe8d-b1d5-408d-af6a-77959b835b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:42.305395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ffe8d-b1d5-408d-af6a-77959b835b10 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:42.305683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ffe8d-b1d5-408d-af6a-77959b835b10 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:42.305956 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ffe8d-b1d5-408d-af6a-77959b835b10 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:42.306650 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ffe8d-b1d5-408d-af6a-77959b835b10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:42.308087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ffe8d-b1d5-408d-af6a-77959b835b10 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:42.332051 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 28/61] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:41:42 2022] POST /identity/v3/users => generated 275 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:45.823154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0ac71-8691-4329-97f8-b8e0e01ba5df None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:45.823702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0ac71-8691-4329-97f8-b8e0e01ba5df None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:45.823702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0ac71-8691-4329-97f8-b8e0e01ba5df None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:45.825512 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 34/62] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:45.832408 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705a37a-0be5-4d18-9291-2d54101d09f5 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:45.833916 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705a37a-0be5-4d18-9291-2d54101d09f5 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:45.835055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705a37a-0be5-4d18-9291-2d54101d09f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:45.869642 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-4705a37a-0be5-4d18-9291-2d54101d09f5 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:45.871156 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-4705a37a-0be5-4d18-9291-2d54101d09f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:45.886646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c2744-bc63-44b9-ac37-07260b22209b None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:45.887149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c2744-bc63-44b9-ac37-07260b22209b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:45.887615 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c2744-bc63-44b9-ac37-07260b22209b None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:45.889191 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 35/63] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:41:45.893968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be6f2-00e9-4884-9e6a-a99de3cb1062 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:45.894482 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be6f2-00e9-4884-9e6a-a99de3cb1062 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:45.894977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be6f2-00e9-4884-9e6a-a99de3cb1062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:45.916092 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-7e0be6f2-00e9-4884-9e6a-a99de3cb1062 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:45.919083 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-7e0be6f2-00e9-4884-9e6a-a99de3cb1062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:45.965804 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:45.999938 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 29/64] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:46.025423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf0fe-dcfa-4f05-9dce-703f4d67985b None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.025935 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf0fe-dcfa-4f05-9dce-703f4d67985b None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.026861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf0fe-dcfa-4f05-9dce-703f4d67985b None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.028902 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 30/65] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:46.030195 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf0fe-dcfa-4f05-9dce-703f4d67985b None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:46.055188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 36/66] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:46.056894 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575214-ac6e-49d2-9eda-5d43f8b51082 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.057472 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575214-ac6e-49d2-9eda-5d43f8b51082 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.058804 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575214-ac6e-49d2-9eda-5d43f8b51082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.089251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-74575214-ac6e-49d2-9eda-5d43f8b51082 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:46.091821 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-74575214-ac6e-49d2-9eda-5d43f8b51082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:46.155614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:46.161112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf0fe-dcfa-4f05-9dce-703f4d67985b None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:46.165344 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 37/67] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:46.166226 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74575214-ac6e-49d2-9eda-5d43f8b51082 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:46.198214 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9004a0-66a6-4527-8783-1fcb45c20651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:46.199570 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9004a0-66a6-4527-8783-1fcb45c20651 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.200550 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9004a0-66a6-4527-8783-1fcb45c20651 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.201041 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9004a0-66a6-4527-8783-1fcb45c20651 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.215679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9004a0-66a6-4527-8783-1fcb45c20651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-3b9004a0-66a6-4527-8783-1fcb45c20651 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:46.225205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:46.226222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:46.226979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:46.227561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 31/68] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:46.228147 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9004a0-66a6-4527-8783-1fcb45c20651 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:46.264579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:46.303638 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74575214-ac6e-49d2-9eda-5d43f8b51082 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:46.332637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9004a0-66a6-4527-8783-1fcb45c20651 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:46.340899 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a1b19-870b-4088-8832-9ee8333f671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:46.341779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a1b19-870b-4088-8832-9ee8333f671f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.342059 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a1b19-870b-4088-8832-9ee8333f671f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.342337 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a1b19-870b-4088-8832-9ee8333f671f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.353014 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a1b19-870b-4088-8832-9ee8333f671f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-1c3a1b19-870b-4088-8832-9ee8333f671f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:46.361815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:46.362666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:41:46.363424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 38/69] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:46.364657 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c49f5-dfcd-4772-a801-ea83498c012e None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.364657 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c49f5-dfcd-4772-a801-ea83498c012e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.364810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c49f5-dfcd-4772-a801-ea83498c012e None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.369326 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 39/70] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:46.369326 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c49f5-dfcd-4772-a801-ea83498c012e None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:46.372873 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e9e28-eb4e-4a40-b741-a7befbd1063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:46.373711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e9e28-eb4e-4a40-b741-a7befbd1063a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.373998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e9e28-eb4e-4a40-b741-a7befbd1063a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.374275 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e9e28-eb4e-4a40-b741-a7befbd1063a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.385174 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e9e28-eb4e-4a40-b741-a7befbd1063a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-679e9e28-eb4e-4a40-b741-a7befbd1063a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:46.393349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:46.394258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:46.395044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 32/71] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:46.395813 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972f17f-d30b-4950-b03c-14c7526e3a41 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.396097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972f17f-d30b-4950-b03c-14c7526e3a41 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.396354 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972f17f-d30b-4950-b03c-14c7526e3a41 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.397653 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 33/72] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:46.402157 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972f17f-d30b-4950-b03c-14c7526e3a41 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:46.429922 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:46.475004 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c49f5-dfcd-4772-a801-ea83498c012e None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:46.496067 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:46.504432 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972f17f-d30b-4950-b03c-14c7526e3a41 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:46.508349 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b915a3-f3df-4339-8b19-5182646f8e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:46.509015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b915a3-f3df-4339-8b19-5182646f8e87 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.509327 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b915a3-f3df-4339-8b19-5182646f8e87 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.509613 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b915a3-f3df-4339-8b19-5182646f8e87 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.510359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b915a3-f3df-4339-8b19-5182646f8e87 None admin] RBAC: Adding query filter params (name=member) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:46.510672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b915a3-f3df-4339-8b19-5182646f8e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:46.512057 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b915a3-f3df-4339-8b19-5182646f8e87 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:46.520089 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 40/73] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:46.521303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a842a8c-605e-4e53-aac1-3a8b75c10a57 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.521609 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a842a8c-605e-4e53-aac1-3a8b75c10a57 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.521889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a842a8c-605e-4e53-aac1-3a8b75c10a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.537441 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd712a-4111-4790-bce0-68c4a96936b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:46.538103 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd712a-4111-4790-bce0-68c4a96936b1 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.538232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-0a842a8c-605e-4e53-aac1-3a8b75c10a57 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:46.538435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd712a-4111-4790-bce0-68c4a96936b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.538717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd712a-4111-4790-bce0-68c4a96936b1 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.539411 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-0a842a8c-605e-4e53-aac1-3a8b75c10a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:46.539498 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd712a-4111-4790-bce0-68c4a96936b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:46.539744 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd712a-4111-4790-bce0-68c4a96936b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:46.541121 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd712a-4111-4790-bce0-68c4a96936b1 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:46.549508 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 34/74] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:46.550284 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd712a-4111-4790-bce0-68c4a96936b1 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:46.608218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 41/75] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:46.609526 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2ca4-00d2-471f-9f35-e44a35bb1d91 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.609826 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2ca4-00d2-471f-9f35-e44a35bb1d91 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.610105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e2ca4-00d2-471f-9f35-e44a35bb1d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.636016 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-c34e2ca4-00d2-471f-9f35-e44a35bb1d91 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:46.637250 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-c34e2ca4-00d2-471f-9f35-e44a35bb1d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:46.651734 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd712a-4111-4790-bce0-68c4a96936b1 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:46.681095 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:46.685898 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc86442-90cc-4bdf-89e0-079a242530ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:46.686586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc86442-90cc-4bdf-89e0-079a242530ae None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.686871 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc86442-90cc-4bdf-89e0-079a242530ae None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.687149 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc86442-90cc-4bdf-89e0-079a242530ae None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.687884 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc86442-90cc-4bdf-89e0-079a242530ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:46.688190 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc86442-90cc-4bdf-89e0-079a242530ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:46.689643 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc86442-90cc-4bdf-89e0-079a242530ae None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:46.701987 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 35/76] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:46.701987 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc86442-90cc-4bdf-89e0-079a242530ae None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:46.710054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 42/77] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:46.710935 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e2ca4-00d2-471f-9f35-e44a35bb1d91 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:46.718388 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:46.801964 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc86442-90cc-4bdf-89e0-079a242530ae None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:46.810210 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e2ca4-00d2-471f-9f35-e44a35bb1d91 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:46.834432 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8354a97-33fe-40ab-8711-1f87efaa4930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:46.835293 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8354a97-33fe-40ab-8711-1f87efaa4930 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.835586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8354a97-33fe-40ab-8711-1f87efaa4930 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.835868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8354a97-33fe-40ab-8711-1f87efaa4930 None admin] PATH_INFO: `/v3/users/0fbe2a791a454dbc9269f301d02d0d98` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.843309 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb69e-1220-4aa2-981c-af37d2c9e6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:46.844210 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb69e-1220-4aa2-981c-af37d2c9e6e0 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.844488 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb69e-1220-4aa2-981c-af37d2c9e6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.844769 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cb69e-1220-4aa2-981c-af37d2c9e6e0 None admin] PATH_INFO: `/v3/users/0fbe2a791a454dbc9269f301d02d0d98` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.849652 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8354a97-33fe-40ab-8711-1f87efaa4930 None admin] RBAC: Authorizing `identity:get_user(user_id=0fbe2a791a454dbc9269f301d02d0d98)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:46.851118 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8354a97-33fe-40ab-8711-1f87efaa4930 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:46.853000 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 36/78] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/users/0fbe2a791a454dbc9269f301d02d0d98 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:46.853562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8354a97-33fe-40ab-8711-1f87efaa4930 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:46.863557 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cb69e-1220-4aa2-981c-af37d2c9e6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=0fbe2a791a454dbc9269f301d02d0d98)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:46.865209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cb69e-1220-4aa2-981c-af37d2c9e6e0 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:46.867117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 43/79] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/users/0fbe2a791a454dbc9269f301d02d0d98 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:46.867808 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb69e-1220-4aa2-981c-af37d2c9e6e0 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:46.903711 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:46.933547 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:46.956343 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8354a97-33fe-40ab-8711-1f87efaa4930 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:46.968745 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cb69e-1220-4aa2-981c-af37d2c9e6e0 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:46.989438 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff0158-9378-4167-8fd0-4208239bf530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:46.990232 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff0158-9378-4167-8fd0-4208239bf530 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:46.990521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff0158-9378-4167-8fd0-4208239bf530 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:46.990802 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff0158-9378-4167-8fd0-4208239bf530 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:46.991982 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff0158-9378-4167-8fd0-4208239bf530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:46.993476 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff0158-9378-4167-8fd0-4208239bf530 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:46.995105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 37/80] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:46.995864 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff0158-9378-4167-8fd0-4208239bf530 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:47.002274 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10477a-c757-4382-8474-dc45118884ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:47.003139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10477a-c757-4382-8474-dc45118884ab None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:47.003421 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10477a-c757-4382-8474-dc45118884ab None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:47.003697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10477a-c757-4382-8474-dc45118884ab None admin] PATH_INFO: `/v3/users/ca16bce227ff43aa8e414592d2c86bfd` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:47.004877 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10477a-c757-4382-8474-dc45118884ab None admin] RBAC: Authorizing `identity:get_user(user_id=ca16bce227ff43aa8e414592d2c86bfd)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:47.006366 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10477a-c757-4382-8474-dc45118884ab None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:47.008008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 44/81] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/users/ca16bce227ff43aa8e414592d2c86bfd => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:47.008761 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10477a-c757-4382-8474-dc45118884ab None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:47.095254 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff0158-9378-4167-8fd0-4208239bf530 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:47.104093 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10477a-c757-4382-8474-dc45118884ab None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:47.105591 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:47.129972 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80638-25fd-4831-bd5f-21559abe7059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:47.130688 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80638-25fd-4831-bd5f-21559abe7059 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:47.130970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80638-25fd-4831-bd5f-21559abe7059 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:47.131243 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c80638-25fd-4831-bd5f-21559abe7059 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:47.139135 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c234ad-4c23-466c-87e3-0fea6738f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:47.139769 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c234ad-4c23-466c-87e3-0fea6738f64a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:47.140052 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c234ad-4c23-466c-87e3-0fea6738f64a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:47.140337 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c234ad-4c23-466c-87e3-0fea6738f64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:47.141014 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c80638-25fd-4831-bd5f-21559abe7059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-84c80638-25fd-4831-bd5f-21559abe7059 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:47.149185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:47.150220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:47.151175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 38/82] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:47.152028 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80638-25fd-4831-bd5f-21559abe7059 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:47.156473 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:47.210229 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c234ad-4c23-466c-87e3-0fea6738f64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:47.211697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c234ad-4c23-466c-87e3-0fea6738f64a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:47.249982 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c80638-25fd-4831-bd5f-21559abe7059 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:47.282997 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d22dc-799e-47f4-bb5d-a7ec2f1e25f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:47.283632 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d22dc-799e-47f4-bb5d-a7ec2f1e25f8 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:47.283914 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d22dc-799e-47f4-bb5d-a7ec2f1e25f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:47.284192 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d22dc-799e-47f4-bb5d-a7ec2f1e25f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:47.306714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 45/83] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:41:47.307611 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c234ad-4c23-466c-87e3-0fea6738f64a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:47.309850 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:47.355599 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d22dc-799e-47f4-bb5d-a7ec2f1e25f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:47.357066 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d22dc-799e-47f4-bb5d-a7ec2f1e25f8 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:47.360680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:47.408350 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c234ad-4c23-466c-87e3-0fea6738f64a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:47.441076 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930d9eb-5e63-4c19-ab7d-c174e5241cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:47.441758 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930d9eb-5e63-4c19-ab7d-c174e5241cd8 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:47.442038 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930d9eb-5e63-4c19-ab7d-c174e5241cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:47.442320 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930d9eb-5e63-4c19-ab7d-c174e5241cd8 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:47.443017 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930d9eb-5e63-4c19-ab7d-c174e5241cd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:47.444440 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930d9eb-5e63-4c19-ab7d-c174e5241cd8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:47.456923 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 39/84] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:41:47.457705 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d22dc-799e-47f4-bb5d-a7ec2f1e25f8 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:47.472882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 46/85] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:41:47 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:47.473775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930d9eb-5e63-4c19-ab7d-c174e5241cd8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:47.561232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:47.571583 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d22dc-799e-47f4-bb5d-a7ec2f1e25f8 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:47.576095 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:47.613130 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930d9eb-5e63-4c19-ab7d-c174e5241cd8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:47.614799 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8f51d-e817-4652-b35e-2fc3e68da17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:47.615577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8f51d-e817-4652-b35e-2fc3e68da17f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:47.615873 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8f51d-e817-4652-b35e-2fc3e68da17f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:47.616160 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8f51d-e817-4652-b35e-2fc3e68da17f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:47.656655 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dcc3d-3190-44f3-8405-1a1e3737d07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:47.657387 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dcc3d-3190-44f3-8405-1a1e3737d07c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:47.657684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dcc3d-3190-44f3-8405-1a1e3737d07c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:47.658018 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dcc3d-3190-44f3-8405-1a1e3737d07c None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:47.658813 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dcc3d-3190-44f3-8405-1a1e3737d07c None admin] RBAC: Adding query filter params (name=member) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:47.659093 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dcc3d-3190-44f3-8405-1a1e3737d07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:47.660453 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dcc3d-3190-44f3-8405-1a1e3737d07c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:47.674203 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 47/86] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:41:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:47.675064 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dcc3d-3190-44f3-8405-1a1e3737d07c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:47.708567 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8f51d-e817-4652-b35e-2fc3e68da17f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:47.710079 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8f51d-e817-4652-b35e-2fc3e68da17f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:47.810007 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dcc3d-3190-44f3-8405-1a1e3737d07c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:47.834776 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:47.834952 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 40/87] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:41:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:41:47.836122 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8f51d-e817-4652-b35e-2fc3e68da17f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:47.840901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:47.854238 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab139346-51e1-4060-9448-ba6805b5f8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:47.855669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139346-51e1-4060-9448-ba6805b5f8a6 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:47.856117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139346-51e1-4060-9448-ba6805b5f8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:47.856643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139346-51e1-4060-9448-ba6805b5f8a6 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:47.858200 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab139346-51e1-4060-9448-ba6805b5f8a6 None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:47.859796 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab139346-51e1-4060-9448-ba6805b5f8a6 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:47.861808 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 48/88] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:47 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:47.862762 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab139346-51e1-4060-9448-ba6805b5f8a6 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:47.966618 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8f51d-e817-4652-b35e-2fc3e68da17f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:47.989369 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab139346-51e1-4060-9448-ba6805b5f8a6 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:48.013395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21071a00-a689-4d3a-adf2-a54989c6d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:48.014535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21071a00-a689-4d3a-adf2-a54989c6d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:48.014912 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21071a00-a689-4d3a-adf2-a54989c6d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:48.015600 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21071a00-a689-4d3a-adf2-a54989c6d7e3 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:48.017067 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21071a00-a689-4d3a-adf2-a54989c6d7e3 None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:48.019582 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21071a00-a689-4d3a-adf2-a54989c6d7e3 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:48.021795 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 41/89] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:47 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:48.025874 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21071a00-a689-4d3a-adf2-a54989c6d7e3 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:48.036973 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810d73-2b90-4973-b2ea-0e29da8c278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:48.038668 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810d73-2b90-4973-b2ea-0e29da8c278f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:48.039123 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810d73-2b90-4973-b2ea-0e29da8c278f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:48.039589 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0810d73-2b90-4973-b2ea-0e29da8c278f None admin] PATH_INFO: `/v3/users/0fbe2a791a454dbc9269f301d02d0d98` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:48.041537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0810d73-2b90-4973-b2ea-0e29da8c278f None admin] RBAC: Authorizing `identity:get_user(user_id=0fbe2a791a454dbc9269f301d02d0d98)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:48.043810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0810d73-2b90-4973-b2ea-0e29da8c278f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:48.046551 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 49/90] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:47 2022] GET /identity/v3/users/0fbe2a791a454dbc9269f301d02d0d98 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:48.051141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810d73-2b90-4973-b2ea-0e29da8c278f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:48.114544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:48.117810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:48.150685 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21071a00-a689-4d3a-adf2-a54989c6d7e3 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:48.167466 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0810d73-2b90-4973-b2ea-0e29da8c278f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:48.187149 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b926523-3321-4182-8a63-bd927182638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:48.188014 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926523-3321-4182-8a63-bd927182638e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:48.188298 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926523-3321-4182-8a63-bd927182638e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:48.188573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926523-3321-4182-8a63-bd927182638e None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:48.190442 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b926523-3321-4182-8a63-bd927182638e None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:48.191895 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b926523-3321-4182-8a63-bd927182638e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:48.193794 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 42/91] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:48 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:48.194670 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b926523-3321-4182-8a63-bd927182638e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:48.205945 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc0c86-8ca4-4362-b992-a6adcb13b556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:48.207030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc0c86-8ca4-4362-b992-a6adcb13b556 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:48.207508 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc0c86-8ca4-4362-b992-a6adcb13b556 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:48.207973 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc0c86-8ca4-4362-b992-a6adcb13b556 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:48.208976 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc0c86-8ca4-4362-b992-a6adcb13b556 None admin] RBAC: Adding query filter params (role.id=a6f65f08e2fc407cad745e9cd18f282d, scope.project.id=e7415ae7a8bf412685572674e06f9d13, user.id=0fbe2a791a454dbc9269f301d02d0d98) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:48.209590 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc0c86-8ca4-4362-b992-a6adcb13b556 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:48.211472 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc0c86-8ca4-4362-b992-a6adcb13b556 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:48.217914 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 50/92] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:41:48 2022] GET /identity/v3/role_assignments?user.id=0fbe2a791a454dbc9269f301d02d0d98&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:48.219038 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc0c86-8ca4-4362-b992-a6adcb13b556 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:48.381258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b926523-3321-4182-8a63-bd927182638e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:48.412100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc0c86-8ca4-4362-b992-a6adcb13b556 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:48.432565 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381f015-0f77-4a61-914a-b6e8c4d9906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:48.433335 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381f015-0f77-4a61-914a-b6e8c4d9906f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:48.433539 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381f015-0f77-4a61-914a-b6e8c4d9906f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:48.433797 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381f015-0f77-4a61-914a-b6e8c4d9906f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:48.434626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381f015-0f77-4a61-914a-b6e8c4d9906f None admin] RBAC: Adding query filter params (role.id=3ca3c240900e4ca5865d244abf112295, scope.project.id=e7415ae7a8bf412685572674e06f9d13, user.id=0fbe2a791a454dbc9269f301d02d0d98) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:48.434935 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381f015-0f77-4a61-914a-b6e8c4d9906f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:48.436370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381f015-0f77-4a61-914a-b6e8c4d9906f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:48.442990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 43/93] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:41:48 2022] GET /identity/v3/role_assignments?user.id=0fbe2a791a454dbc9269f301d02d0d98&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=3ca3c240900e4ca5865d244abf112295 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:48.443860 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381f015-0f77-4a61-914a-b6e8c4d9906f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:48.447408 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:48.456733 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd1dea-f991-45c6-b3cb-b839283554d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:48.457920 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd1dea-f991-45c6-b3cb-b839283554d0 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:48.458450 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd1dea-f991-45c6-b3cb-b839283554d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:48.458924 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd1dea-f991-45c6-b3cb-b839283554d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:48.527160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:48.551758 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381f015-0f77-4a61-914a-b6e8c4d9906f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:48.558432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd1dea-f991-45c6-b3cb-b839283554d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:48.560277 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd1dea-f991-45c6-b3cb-b839283554d0 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:48.587928 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4d48c-a02c-4549-9c47-632d4b4899bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:48.587928 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4d48c-a02c-4549-9c47-632d4b4899bc None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:48.588190 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4d48c-a02c-4549-9c47-632d4b4899bc None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:48.588645 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4d48c-a02c-4549-9c47-632d4b4899bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:48.589587 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4d48c-a02c-4549-9c47-632d4b4899bc None admin] RBAC: Adding query filter params (role.id=948b82ff28c547e78755c196cddfdd0e, scope.project.id=e7415ae7a8bf412685572674e06f9d13, user.id=ca16bce227ff43aa8e414592d2c86bfd) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:48.589967 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4d48c-a02c-4549-9c47-632d4b4899bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:48.591511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4d48c-a02c-4549-9c47-632d4b4899bc None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:48.598312 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 44/94] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:41:48 2022] GET /identity/v3/role_assignments?user.id=ca16bce227ff43aa8e414592d2c86bfd&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=948b82ff28c547e78755c196cddfdd0e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:48.749467 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 51/95] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:41:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:41:48.755602 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4d48c-a02c-4549-9c47-632d4b4899bc None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:48.846227 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:48.874676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4d48c-a02c-4549-9c47-632d4b4899bc None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:48.916333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27320c8-7ab6-4fe2-836a-1215a21f562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:48.917205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27320c8-7ab6-4fe2-836a-1215a21f562f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:48.921757 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27320c8-7ab6-4fe2-836a-1215a21f562f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:48.922049 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27320c8-7ab6-4fe2-836a-1215a21f562f None admin] PATH_INFO: `/v3/projects/d352f855ddb54a81b0093f8f65a06c55` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:48.924057 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27320c8-7ab6-4fe2-836a-1215a21f562f None admin] RBAC: Authorizing `identity:get_project(project_id=d352f855ddb54a81b0093f8f65a06c55)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:48.925574 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27320c8-7ab6-4fe2-836a-1215a21f562f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:48.927334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 45/96] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:48 2022] GET /identity/v3/projects/d352f855ddb54a81b0093f8f65a06c55 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:48.934350 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd1dea-f991-45c6-b3cb-b839283554d0 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:48.966066 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:49.084762 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd1dea-f991-45c6-b3cb-b839283554d0 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:49.132499 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e0cf1-7adf-4690-a57a-7382aa8042e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:49.133086 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e0cf1-7adf-4690-a57a-7382aa8042e2 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:49.133399 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e0cf1-7adf-4690-a57a-7382aa8042e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:49.133683 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e0cf1-7adf-4690-a57a-7382aa8042e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:49.134522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e0cf1-7adf-4690-a57a-7382aa8042e2 None admin] RBAC: Adding query filter params (role.id=a6f65f08e2fc407cad745e9cd18f282d, scope.project.id=d352f855ddb54a81b0093f8f65a06c55, user.id=0fbe2a791a454dbc9269f301d02d0d98) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:49.134841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e0cf1-7adf-4690-a57a-7382aa8042e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:49.136280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e0cf1-7adf-4690-a57a-7382aa8042e2 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:49.142868 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 52/97] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:41:48 2022] GET /identity/v3/role_assignments?user.id=0fbe2a791a454dbc9269f301d02d0d98&scope.project.id=d352f855ddb54a81b0093f8f65a06c55&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:50.607161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00436ee-ca05-4a3a-8015-c4f9bcddab6c None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:50.607161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00436ee-ca05-4a3a-8015-c4f9bcddab6c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:50.607161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00436ee-ca05-4a3a-8015-c4f9bcddab6c None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:50.607161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 46/98] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:50.613637 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c3092-721e-41d2-8249-f9a24e71c34f None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:50.614393 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c3092-721e-41d2-8249-f9a24e71c34f None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:50.614818 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c3092-721e-41d2-8249-f9a24e71c34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:50.635243 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-448c3092-721e-41d2-8249-f9a24e71c34f None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:50.636818 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-448c3092-721e-41d2-8249-f9a24e71c34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:50.704344 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 53/99] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:50.750811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00436ee-ca05-4a3a-8015-c4f9bcddab6c None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:50.903872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00436ee-ca05-4a3a-8015-c4f9bcddab6c None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:50.950069 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096f7cb-50f7-470e-89be-0cc81183a2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:50.950873 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096f7cb-50f7-470e-89be-0cc81183a2ad None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:50.951155 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096f7cb-50f7-470e-89be-0cc81183a2ad None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:50.951430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096f7cb-50f7-470e-89be-0cc81183a2ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:50.959821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:50.968671 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096f7cb-50f7-470e-89be-0cc81183a2ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-5096f7cb-50f7-470e-89be-0cc81183a2ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:50.977578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:50.978453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:50.979307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 47/100] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:50.986939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c3092-721e-41d2-8249-f9a24e71c34f None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:51.006416 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:51.118136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64e89c-5e24-47ea-9298-04e1f1b886f1 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.118420 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64e89c-5e24-47ea-9298-04e1f1b886f1 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.118700 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64e89c-5e24-47ea-9298-04e1f1b886f1 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.120083 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 48/101] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:41:51.125072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e7176-112e-472c-9e3a-37f59f1f3448 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.125384 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e7176-112e-472c-9e3a-37f59f1f3448 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.125668 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e7176-112e-472c-9e3a-37f59f1f3448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.128057 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c3092-721e-41d2-8249-f9a24e71c34f None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:51.155109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-a21e7176-112e-472c-9e3a-37f59f1f3448 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:51.156507 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-a21e7176-112e-472c-9e3a-37f59f1f3448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:51.254580 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 49/102] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:41:51.254814 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8325a9-65d9-44cd-971d-a9b7eb047bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:51.255270 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8325a9-65d9-44cd-971d-a9b7eb047bc9 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.255617 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8325a9-65d9-44cd-971d-a9b7eb047bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.255889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8325a9-65d9-44cd-971d-a9b7eb047bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.256844 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8325a9-65d9-44cd-971d-a9b7eb047bc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:51.257160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8325a9-65d9-44cd-971d-a9b7eb047bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:51.258574 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8325a9-65d9-44cd-971d-a9b7eb047bc9 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:51.270212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 54/103] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:41:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:51.278445 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e7176-112e-472c-9e3a-37f59f1f3448 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:51.302657 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8325a9-65d9-44cd-971d-a9b7eb047bc9 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:51.479523 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8325a9-65d9-44cd-971d-a9b7eb047bc9 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:51.493512 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:51.545815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626825-1033-43cd-8591-e294a365bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:51.547018 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626825-1033-43cd-8591-e294a365bf6f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.547305 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626825-1033-43cd-8591-e294a365bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.547798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be626825-1033-43cd-8591-e294a365bf6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.549310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be626825-1033-43cd-8591-e294a365bf6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:51.550801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be626825-1033-43cd-8591-e294a365bf6f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:51.552794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 55/104] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:51.558203 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626825-1033-43cd-8591-e294a365bf6f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:51.572126 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e7176-112e-472c-9e3a-37f59f1f3448 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:51.632390 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:51.657437 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b26ce-2365-4419-b210-8864486c0fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:51.658793 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b26ce-2365-4419-b210-8864486c0fc6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.659533 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b26ce-2365-4419-b210-8864486c0fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.660216 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b26ce-2365-4419-b210-8864486c0fc6 None admin] PATH_INFO: `/v3/users/bc35680d2f4f44f6ae8fa874f5e57c81` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.676916 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b26ce-2365-4419-b210-8864486c0fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=bc35680d2f4f44f6ae8fa874f5e57c81)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:51.678699 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b26ce-2365-4419-b210-8864486c0fc6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:51.681340 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 50/105] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:51 2022] GET /identity/v3/users/bc35680d2f4f44f6ae8fa874f5e57c81 => generated 289 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:51.682782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99818d7c-f7e6-47b6-adad-255fe273fdfe None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.683240 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99818d7c-f7e6-47b6-adad-255fe273fdfe None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.683684 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99818d7c-f7e6-47b6-adad-255fe273fdfe None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.685225 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 51/106] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:51.686624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abf232-d741-4ddc-9b63-991a9f2994bc None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.687094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abf232-d741-4ddc-9b63-991a9f2994bc None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.687674 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abf232-d741-4ddc-9b63-991a9f2994bc None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.689700 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 52/107] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:51.694790 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abf232-d741-4ddc-9b63-991a9f2994bc None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:51.717774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be626825-1033-43cd-8591-e294a365bf6f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:51.764657 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3b33d-dc9e-48e0-82cd-742d9319ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:51.766136 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b33d-dc9e-48e0-82cd-742d9319ad59 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.766871 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b33d-dc9e-48e0-82cd-742d9319ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.767907 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3b33d-dc9e-48e0-82cd-742d9319ad59 None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.769122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b33d-dc9e-48e0-82cd-742d9319ad59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:51.771333 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea3b33d-dc9e-48e0-82cd-742d9319ad59 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:51.790949 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:51.816639 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 56/108] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Jul 12 18:41:51 2022] POST /identity/v3/projects => generated 302 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:51.823310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36905129-043c-4b41-8053-c0630d9cf902 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.823873 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36905129-043c-4b41-8053-c0630d9cf902 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.824332 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36905129-043c-4b41-8053-c0630d9cf902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.844176 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abf232-d741-4ddc-9b63-991a9f2994bc None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:51.847728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-36905129-043c-4b41-8053-c0630d9cf902 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:51.849150 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-36905129-043c-4b41-8053-c0630d9cf902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:51.929625 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f05de-c157-432a-ad14-3423df1add05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:51.930483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f05de-c157-432a-ad14-3423df1add05 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.930907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f05de-c157-432a-ad14-3423df1add05 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.931282 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f05de-c157-432a-ad14-3423df1add05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.948671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 57/109] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:51.950430 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40910-4000-4712-aa99-3c76a3e65648 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:51.950949 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40910-4000-4712-aa99-3c76a3e65648 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:51.951429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a40910-4000-4712-aa99-3c76a3e65648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:51.984760 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-b6a40910-4000-4712-aa99-3c76a3e65648 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:51.987918 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-b6a40910-4000-4712-aa99-3c76a3e65648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:52.034934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:52.055508 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f05de-c157-432a-ad14-3423df1add05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:52.057424 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f05de-c157-432a-ad14-3423df1add05 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:52.088762 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 58/110] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:52.094444 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b9924-4e34-4718-bd3e-5d58110b4673 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.094766 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b9924-4e34-4718-bd3e-5d58110b4673 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.095044 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b9924-4e34-4718-bd3e-5d58110b4673 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.096983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 59/111] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:52.101896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b9924-4e34-4718-bd3e-5d58110b4673 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:52.183060 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 53/112] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:41:52.184733 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a419-c3d0-4b32-b639-d0f931a79d2c None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.185028 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a419-c3d0-4b32-b639-d0f931a79d2c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.185320 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508a419-c3d0-4b32-b639-d0f931a79d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.194187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:52.208866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-e508a419-c3d0-4b32-b639-d0f931a79d2c None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:52.210507 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-e508a419-c3d0-4b32-b639-d0f931a79d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:52.252304 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b9924-4e34-4718-bd3e-5d58110b4673 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:52.289117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126b01b-be4e-4faf-aaad-539f20233af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:52.289883 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b01b-be4e-4faf-aaad-539f20233af4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.290165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b01b-be4e-4faf-aaad-539f20233af4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.290444 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126b01b-be4e-4faf-aaad-539f20233af4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.296683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 54/113] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:52.297340 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508a419-c3d0-4b32-b639-d0f931a79d2c None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:52.301225 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126b01b-be4e-4faf-aaad-539f20233af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-8126b01b-be4e-4faf-aaad-539f20233af4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:52.309475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:52.310335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 60/114] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:41:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:52.311537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126b01b-be4e-4faf-aaad-539f20233af4 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:52.329034 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:52.423890 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126b01b-be4e-4faf-aaad-539f20233af4 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:52.439779 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508a419-c3d0-4b32-b639-d0f931a79d2c None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:52.443765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:52.463683 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720cfd0-eafd-47e2-a9fe-4f50e432d806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:52.464690 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720cfd0-eafd-47e2-a9fe-4f50e432d806 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.465043 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720cfd0-eafd-47e2-a9fe-4f50e432d806 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.465342 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720cfd0-eafd-47e2-a9fe-4f50e432d806 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.466555 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720cfd0-eafd-47e2-a9fe-4f50e432d806 None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:52.468007 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720cfd0-eafd-47e2-a9fe-4f50e432d806 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:52.469951 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 61/115] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:52 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:52.470544 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720cfd0-eafd-47e2-a9fe-4f50e432d806 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:52.479182 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80c68b-d70d-4987-87cc-ed8255d18e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:52.479977 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80c68b-d70d-4987-87cc-ed8255d18e2c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.480369 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80c68b-d70d-4987-87cc-ed8255d18e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.480651 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80c68b-d70d-4987-87cc-ed8255d18e2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.492050 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd80c68b-d70d-4987-87cc-ed8255d18e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-dd80c68b-d70d-4987-87cc-ed8255d18e2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:52.500410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:52.503203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 55/116] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:52.504382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80c68b-d70d-4987-87cc-ed8255d18e2c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:52.583397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720cfd0-eafd-47e2-a9fe-4f50e432d806 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:52.599202 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:52.621424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7398fa-d7e7-4187-8367-2678f8cfa415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:52.622102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7398fa-d7e7-4187-8367-2678f8cfa415 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.622424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7398fa-d7e7-4187-8367-2678f8cfa415 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.622712 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7398fa-d7e7-4187-8367-2678f8cfa415 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.623454 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7398fa-d7e7-4187-8367-2678f8cfa415 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:52.623765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7398fa-d7e7-4187-8367-2678f8cfa415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:52.625153 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7398fa-d7e7-4187-8367-2678f8cfa415 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:52.627354 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd80c68b-d70d-4987-87cc-ed8255d18e2c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:52.634055 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 62/117] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:41:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:52.634697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7398fa-d7e7-4187-8367-2678f8cfa415 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:52.669693 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019f520-54b9-4ed1-82d7-4d7c6ee0b3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:52.670574 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019f520-54b9-4ed1-82d7-4d7c6ee0b3dc None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.670920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019f520-54b9-4ed1-82d7-4d7c6ee0b3dc None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.671201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019f520-54b9-4ed1-82d7-4d7c6ee0b3dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.682382 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:52.684005 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019f520-54b9-4ed1-82d7-4d7c6ee0b3dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-9019f520-54b9-4ed1-82d7-4d7c6ee0b3dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:52.692548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:52.693484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:52.694255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 56/118] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:41:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:52.694906 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019f520-54b9-4ed1-82d7-4d7c6ee0b3dc None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:52.743837 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7398fa-d7e7-4187-8367-2678f8cfa415 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:52.778312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959f431-3c6b-458c-a2b9-abb291dd288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:52.778969 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959f431-3c6b-458c-a2b9-abb291dd288e None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.779273 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959f431-3c6b-458c-a2b9-abb291dd288e None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.779551 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959f431-3c6b-458c-a2b9-abb291dd288e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.780368 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959f431-3c6b-458c-a2b9-abb291dd288e None admin] RBAC: Adding query filter params (role.id=b74601dfd03749c3a08d4097fc9c2868, scope.project.id=e7415ae7a8bf412685572674e06f9d13, user.id=bc35680d2f4f44f6ae8fa874f5e57c81) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:52.780682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959f431-3c6b-458c-a2b9-abb291dd288e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:52.782451 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959f431-3c6b-458c-a2b9-abb291dd288e None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:52.788747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 63/119] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:41:52 2022] GET /identity/v3/role_assignments?user.id=bc35680d2f4f44f6ae8fa874f5e57c81&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=b74601dfd03749c3a08d4097fc9c2868 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:52.789895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19bda5-a9b6-4398-8654-ce84cd4d111a None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.790209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19bda5-a9b6-4398-8654-ce84cd4d111a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.790462 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19bda5-a9b6-4398-8654-ce84cd4d111a None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.793399 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 64/120] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:52.793399 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19bda5-a9b6-4398-8654-ce84cd4d111a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:52.811065 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019f520-54b9-4ed1-82d7-4d7c6ee0b3dc None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:52.871415 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a6443-0081-4050-8189-197391060129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:52.872678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6443-0081-4050-8189-197391060129 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.873050 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6443-0081-4050-8189-197391060129 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.873490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6443-0081-4050-8189-197391060129 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.874726 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a6443-0081-4050-8189-197391060129 None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:52.875212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a6443-0081-4050-8189-197391060129 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:52.880719 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a6443-0081-4050-8189-197391060129 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:52.882760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:52.898233 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 57/121] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:41:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:52.898233 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a6443-0081-4050-8189-197391060129 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:52.941938 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19bda5-a9b6-4398-8654-ce84cd4d111a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:52.956697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:52.988772 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71a35d-7178-4eb0-a8fb-730d138ff804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:52.990595 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71a35d-7178-4eb0-a8fb-730d138ff804 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:52.990881 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71a35d-7178-4eb0-a8fb-730d138ff804 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:52.991159 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71a35d-7178-4eb0-a8fb-730d138ff804 None admin] PATH_INFO: `/v3/users/0fbe2a791a454dbc9269f301d02d0d98` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:52.992648 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71a35d-7178-4eb0-a8fb-730d138ff804 None admin] RBAC: Authorizing `identity:get_user(user_id=0fbe2a791a454dbc9269f301d02d0d98)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:52.995775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71a35d-7178-4eb0-a8fb-730d138ff804 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:52.998217 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 65/122] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:52 2022] GET /identity/v3/users/0fbe2a791a454dbc9269f301d02d0d98 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:53.005814 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c035c7-8208-4ea8-9cb0-dbab0593b0ae None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:53.006092 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c035c7-8208-4ea8-9cb0-dbab0593b0ae None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:53.006372 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c035c7-8208-4ea8-9cb0-dbab0593b0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:53.027544 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-22c035c7-8208-4ea8-9cb0-dbab0593b0ae None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:53.028900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-22c035c7-8208-4ea8-9cb0-dbab0593b0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:53.036381 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a6443-0081-4050-8189-197391060129 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:53.076398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ccad-6863-4ffc-be9b-3c10d9279492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:53.077107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ccad-6863-4ffc-be9b-3c10d9279492 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:53.077423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ccad-6863-4ffc-be9b-3c10d9279492 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:53.077747 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6ccad-6863-4ffc-be9b-3c10d9279492 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:53.078490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6ccad-6863-4ffc-be9b-3c10d9279492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:53.078792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6ccad-6863-4ffc-be9b-3c10d9279492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:53.080648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6ccad-6863-4ffc-be9b-3c10d9279492 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:53.091426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 58/123] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:53.097574 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ccad-6863-4ffc-be9b-3c10d9279492 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:53.114225 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 66/124] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:53.115082 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c035c7-8208-4ea8-9cb0-dbab0593b0ae None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:53.184031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:53.231453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6ccad-6863-4ffc-be9b-3c10d9279492 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:53.235234 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c035c7-8208-4ea8-9cb0-dbab0593b0ae None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:53.245812 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:53.271669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f24b1-055b-4a58-b265-2450da0e638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:53.271898 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a71d23-95f1-4ed1-9a42-dd0525e09916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:53.272783 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f24b1-055b-4a58-b265-2450da0e638f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:53.273057 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a71d23-95f1-4ed1-9a42-dd0525e09916 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:53.273246 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f24b1-055b-4a58-b265-2450da0e638f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:53.273653 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f24b1-055b-4a58-b265-2450da0e638f None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:53.273776 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a71d23-95f1-4ed1-9a42-dd0525e09916 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:53.274181 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a71d23-95f1-4ed1-9a42-dd0525e09916 None admin] PATH_INFO: `/v3/users/0fbe2a791a454dbc9269f301d02d0d98` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:53.275114 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f24b1-055b-4a58-b265-2450da0e638f None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:53.275685 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a71d23-95f1-4ed1-9a42-dd0525e09916 None admin] RBAC: Authorizing `identity:get_user(user_id=0fbe2a791a454dbc9269f301d02d0d98)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:53.276755 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f24b1-055b-4a58-b265-2450da0e638f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:53.277459 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a71d23-95f1-4ed1-9a42-dd0525e09916 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:53.278726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 67/125] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:53 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:53.279384 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 59/126] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:53 2022] GET /identity/v3/users/0fbe2a791a454dbc9269f301d02d0d98 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:53.279932 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f24b1-055b-4a58-b265-2450da0e638f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:53.280596 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a71d23-95f1-4ed1-9a42-dd0525e09916 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:53.391492 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f24b1-055b-4a58-b265-2450da0e638f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:53.409669 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a71d23-95f1-4ed1-9a42-dd0525e09916 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:53.430890 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2601000-1fe9-4d6b-a2b2-8b609906c401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:53.431961 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2601000-1fe9-4d6b-a2b2-8b609906c401 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:53.432347 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2601000-1fe9-4d6b-a2b2-8b609906c401 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:53.432723 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2601000-1fe9-4d6b-a2b2-8b609906c401 None admin] PATH_INFO: `/v3/users/ca16bce227ff43aa8e414592d2c86bfd` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:53.434120 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2601000-1fe9-4d6b-a2b2-8b609906c401 None admin] RBAC: Authorizing `identity:get_user(user_id=ca16bce227ff43aa8e414592d2c86bfd)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:53.435612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2601000-1fe9-4d6b-a2b2-8b609906c401 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:53.438098 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 68/127] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:53 2022] GET /identity/v3/users/ca16bce227ff43aa8e414592d2c86bfd => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:53.438733 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2601000-1fe9-4d6b-a2b2-8b609906c401 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:53.444405 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:53.455756 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b7296-bd3c-451f-8843-5e42aaae1992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:53.456732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b7296-bd3c-451f-8843-5e42aaae1992 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:53.457188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b7296-bd3c-451f-8843-5e42aaae1992 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:53.457651 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b7296-bd3c-451f-8843-5e42aaae1992 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:53.469071 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b7296-bd3c-451f-8843-5e42aaae1992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-e17b7296-bd3c-451f-8843-5e42aaae1992 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:53.477992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:53.478868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:53.479721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:53.482150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 60/128] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:53.483189 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b7296-bd3c-451f-8843-5e42aaae1992 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:53.489940 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:53.545779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2601000-1fe9-4d6b-a2b2-8b609906c401 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:53.581309 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc11bc-0c1c-4c83-9211-8dc0efbe09df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:53.582463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc11bc-0c1c-4c83-9211-8dc0efbe09df None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:53.582819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc11bc-0c1c-4c83-9211-8dc0efbe09df None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:53.583171 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc11bc-0c1c-4c83-9211-8dc0efbe09df None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13/users/0fbe2a791a454dbc9269f301d02d0d98/roles/3ca3c240900e4ca5865d244abf112295` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:53.586857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc11bc-0c1c-4c83-9211-8dc0efbe09df None admin] RBAC: Authorizing `identity:create_grant(project_id=e7415ae7a8bf412685572674e06f9d13, user_id=0fbe2a791a454dbc9269f301d02d0d98, role_id=3ca3c240900e4ca5865d244abf112295)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:53.588843 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc11bc-0c1c-4c83-9211-8dc0efbe09df None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:53.603909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b7296-bd3c-451f-8843-5e42aaae1992 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:53.609314 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 69/129] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:41:53 2022] PUT /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13/users/0fbe2a791a454dbc9269f301d02d0d98/roles/3ca3c240900e4ca5865d244abf112295 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:53.610183 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc11bc-0c1c-4c83-9211-8dc0efbe09df None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:53.645643 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a97e0-8cf5-4d93-9d98-57adc730a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:53.647019 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a97e0-8cf5-4d93-9d98-57adc730a417 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:53.647535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a97e0-8cf5-4d93-9d98-57adc730a417 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:53.648019 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a97e0-8cf5-4d93-9d98-57adc730a417 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:53.650065 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a97e0-8cf5-4d93-9d98-57adc730a417 None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:53.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a97e0-8cf5-4d93-9d98-57adc730a417 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:53.654256 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 61/130] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:53 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:53.655266 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a97e0-8cf5-4d93-9d98-57adc730a417 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:53.720737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:53.752993 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc11bc-0c1c-4c83-9211-8dc0efbe09df None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:53.756471 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:53.799214 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a97e0-8cf5-4d93-9d98-57adc730a417 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:53.830793 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf47168-ce07-4136-a0db-69648d5aa2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:53.832016 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf47168-ce07-4136-a0db-69648d5aa2f9 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:53.833552 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf47168-ce07-4136-a0db-69648d5aa2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:53.834081 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf47168-ce07-4136-a0db-69648d5aa2f9 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:53.838476 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf47168-ce07-4136-a0db-69648d5aa2f9 None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:53.840257 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf47168-ce07-4136-a0db-69648d5aa2f9 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:53.843323 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 70/131] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:53 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:53.846104 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf47168-ce07-4136-a0db-69648d5aa2f9 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:53.870600 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045064e-cac0-4218-aff3-a87c5849dc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:53.871745 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045064e-cac0-4218-aff3-a87c5849dc39 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:53.873578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045064e-cac0-4218-aff3-a87c5849dc39 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:53.874286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045064e-cac0-4218-aff3-a87c5849dc39 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:53.876041 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045064e-cac0-4218-aff3-a87c5849dc39 None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:53.877313 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045064e-cac0-4218-aff3-a87c5849dc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:53.880328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045064e-cac0-4218-aff3-a87c5849dc39 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:53.898856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 62/132] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:41:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:53.900619 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045064e-cac0-4218-aff3-a87c5849dc39 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:54.014897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf47168-ce07-4136-a0db-69648d5aa2f9 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:54.035503 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045064e-cac0-4218-aff3-a87c5849dc39 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:54.053868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:54.056678 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb9cd2-9500-464c-9507-522a73728b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:54.057779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb9cd2-9500-464c-9507-522a73728b49 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:54.058164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb9cd2-9500-464c-9507-522a73728b49 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:54.058553 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb9cd2-9500-464c-9507-522a73728b49 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13/users/0fbe2a791a454dbc9269f301d02d0d98/roles/a6f65f08e2fc407cad745e9cd18f282d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:54.061011 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb9cd2-9500-464c-9507-522a73728b49 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7415ae7a8bf412685572674e06f9d13, user_id=0fbe2a791a454dbc9269f301d02d0d98, role_id=a6f65f08e2fc407cad745e9cd18f282d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:54.062587 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb9cd2-9500-464c-9507-522a73728b49 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:54.075735 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85bc03-b818-455f-b676-8c52809d5bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:54.076933 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85bc03-b818-455f-b676-8c52809d5bc4 None admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:54.077519 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85bc03-b818-455f-b676-8c52809d5bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:54.077974 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85bc03-b818-455f-b676-8c52809d5bc4 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13/users/ca16bce227ff43aa8e414592d2c86bfd/roles/948b82ff28c547e78755c196cddfdd0e` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:54.080727 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85bc03-b818-455f-b676-8c52809d5bc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7415ae7a8bf412685572674e06f9d13, user_id=ca16bce227ff43aa8e414592d2c86bfd, role_id=948b82ff28c547e78755c196cddfdd0e)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:54.082297 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 71/133] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:41:53 2022] PUT /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13/users/0fbe2a791a454dbc9269f301d02d0d98/roles/a6f65f08e2fc407cad745e9cd18f282d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:54.082644 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85bc03-b818-455f-b676-8c52809d5bc4 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:54.083405 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb9cd2-9500-464c-9507-522a73728b49 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:54.115857 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 63/134] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:41:53 2022] PUT /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13/users/ca16bce227ff43aa8e414592d2c86bfd/roles/948b82ff28c547e78755c196cddfdd0e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:54.120018 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:54.203528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb9cd2-9500-464c-9507-522a73728b49 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:54.241842 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055005b8-c998-4e86-a853-d350b06ed77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:54.242739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055005b8-c998-4e86-a853-d350b06ed77e None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:54.243024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055005b8-c998-4e86-a853-d350b06ed77e None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:54.243502 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055005b8-c998-4e86-a853-d350b06ed77e None admin] PATH_INFO: `/v3/users/0fbe2a791a454dbc9269f301d02d0d98` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:54.245211 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055005b8-c998-4e86-a853-d350b06ed77e None admin] RBAC: Authorizing `identity:get_user(user_id=0fbe2a791a454dbc9269f301d02d0d98)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:54.246721 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055005b8-c998-4e86-a853-d350b06ed77e None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:54.248489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 72/135] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:54 2022] GET /identity/v3/users/0fbe2a791a454dbc9269f301d02d0d98 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:54.254959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85bc03-b818-455f-b676-8c52809d5bc4 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:54.395078 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85bc03-b818-455f-b676-8c52809d5bc4 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:54.434845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf57be-984a-46fe-9551-19eb1279e384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:54.435735 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf57be-984a-46fe-9551-19eb1279e384 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:54.436019 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf57be-984a-46fe-9551-19eb1279e384 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:54.436301 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf57be-984a-46fe-9551-19eb1279e384 None admin] PATH_INFO: `/v3/projects/d352f855ddb54a81b0093f8f65a06c55` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:54.437641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf57be-984a-46fe-9551-19eb1279e384 None admin] RBAC: Authorizing `identity:get_project(project_id=d352f855ddb54a81b0093f8f65a06c55)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:54.439857 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf57be-984a-46fe-9551-19eb1279e384 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:54.441661 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 64/136] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:54 2022] GET /identity/v3/projects/d352f855ddb54a81b0093f8f65a06c55 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:54.447447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055005b8-c998-4e86-a853-d350b06ed77e None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:54.561666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:54.565904 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055005b8-c998-4e86-a853-d350b06ed77e None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:54.602603 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58ca81-9b79-4d9d-a628-13b3c9531b62 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:54.602933 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58ca81-9b79-4d9d-a628-13b3c9531b62 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:54.603165 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58ca81-9b79-4d9d-a628-13b3c9531b62 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:54.604672 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 65/137] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:41:54.609622 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320cf1-772f-4ba8-8893-f968e2f0fcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:54.609776 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335ccf5-ee33-400d-b7e2-556cbadc568d None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:54.609997 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335ccf5-ee33-400d-b7e2-556cbadc568d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:54.610277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335ccf5-ee33-400d-b7e2-556cbadc568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:54.611316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320cf1-772f-4ba8-8893-f968e2f0fcf0 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:54.611801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320cf1-772f-4ba8-8893-f968e2f0fcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:54.612274 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320cf1-772f-4ba8-8893-f968e2f0fcf0 None admin] PATH_INFO: `/v3/projects/d352f855ddb54a81b0093f8f65a06c55/users/0fbe2a791a454dbc9269f301d02d0d98/roles/a6f65f08e2fc407cad745e9cd18f282d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:54.614583 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0320cf1-772f-4ba8-8893-f968e2f0fcf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d352f855ddb54a81b0093f8f65a06c55, user_id=0fbe2a791a454dbc9269f301d02d0d98, role_id=a6f65f08e2fc407cad745e9cd18f282d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:54.616282 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0320cf1-772f-4ba8-8893-f968e2f0fcf0 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:54.652122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 73/138] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:41:54 2022] PUT /identity/v3/projects/d352f855ddb54a81b0093f8f65a06c55/users/0fbe2a791a454dbc9269f301d02d0d98/roles/a6f65f08e2fc407cad745e9cd18f282d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:54.661546 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-9335ccf5-ee33-400d-b7e2-556cbadc568d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:54.663368 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-9335ccf5-ee33-400d-b7e2-556cbadc568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:54.729040 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:54.770785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 66/139] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:41:54.820769 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320cf1-772f-4ba8-8893-f968e2f0fcf0 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:54.950784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320cf1-772f-4ba8-8893-f968e2f0fcf0 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:54.999182 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdcaa8-aa72-4a7a-a05e-7459b6e5c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:54.999988 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdcaa8-aa72-4a7a-a05e-7459b6e5c396 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:55.000269 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdcaa8-aa72-4a7a-a05e-7459b6e5c396 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:55.000551 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdcaa8-aa72-4a7a-a05e-7459b6e5c396 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:55.002417 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdcaa8-aa72-4a7a-a05e-7459b6e5c396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:55.003901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdcaa8-aa72-4a7a-a05e-7459b6e5c396 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:55.005630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 74/140] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:41:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:55.012021 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335ccf5-ee33-400d-b7e2-556cbadc568d None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:55.151869 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335ccf5-ee33-400d-b7e2-556cbadc568d None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:55.194268 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dff94-c02d-4442-8804-5337a412b6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:55.195349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dff94-c02d-4442-8804-5337a412b6a0 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:55.195850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dff94-c02d-4442-8804-5337a412b6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:55.196327 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dff94-c02d-4442-8804-5337a412b6a0 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:55.197356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dff94-c02d-4442-8804-5337a412b6a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:55.199024 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dff94-c02d-4442-8804-5337a412b6a0 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:55.231776 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 67/141] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:41:55 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:41:55.683136 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef4b1-9037-4328-9eea-9bb05149f4ed None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:55.683481 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef4b1-9037-4328-9eea-9bb05149f4ed None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:55.683654 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ef4b1-9037-4328-9eea-9bb05149f4ed None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:55.684996 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 75/142] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:55.691656 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32013e-0ca4-47ba-b104-5128a75d481d None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:55.691944 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32013e-0ca4-47ba-b104-5128a75d481d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:55.692222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32013e-0ca4-47ba-b104-5128a75d481d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:55.715854 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-af32013e-0ca4-47ba-b104-5128a75d481d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:55.717043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-af32013e-0ca4-47ba-b104-5128a75d481d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:55.748987 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:55.803982 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 68/143] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:55.841669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef4b1-9037-4328-9eea-9bb05149f4ed None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:55.896084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:56.009967 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ef4b1-9037-4328-9eea-9bb05149f4ed None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:56.054732 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498f21b-7351-42be-8e19-ffff7b0bcf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:56.055521 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498f21b-7351-42be-8e19-ffff7b0bcf6d None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:56.055894 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498f21b-7351-42be-8e19-ffff7b0bcf6d None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:56.056169 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498f21b-7351-42be-8e19-ffff7b0bcf6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:56.076076 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498f21b-7351-42be-8e19-ffff7b0bcf6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-6498f21b-7351-42be-8e19-ffff7b0bcf6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:56.083989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:56.084847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:41:56.085731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 76/144] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:56.093138 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32013e-0ca4-47ba-b104-5128a75d481d None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:56.224069 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32013e-0ca4-47ba-b104-5128a75d481d None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:56.261556 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63313c72-be26-4648-a4c6-43280133fc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:56.262552 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313c72-be26-4648-a4c6-43280133fc52 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:56.263043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313c72-be26-4648-a4c6-43280133fc52 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:56.263515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313c72-be26-4648-a4c6-43280133fc52 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:56.264454 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63313c72-be26-4648-a4c6-43280133fc52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:56.264952 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63313c72-be26-4648-a4c6-43280133fc52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:56.266580 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63313c72-be26-4648-a4c6-43280133fc52 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:56.275589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 69/145] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:41:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:56.281550 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498f21b-7351-42be-8e19-ffff7b0bcf6d None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:56.395136 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498f21b-7351-42be-8e19-ffff7b0bcf6d None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:56.397918 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:56.432222 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7b6e4-a40e-4bd3-b140-ea50c7a1bf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:56.433099 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7b6e4-a40e-4bd3-b140-ea50c7a1bf8f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:56.433480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7b6e4-a40e-4bd3-b140-ea50c7a1bf8f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:56.433761 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7b6e4-a40e-4bd3-b140-ea50c7a1bf8f None admin] PATH_INFO: `/v3/users/bc35680d2f4f44f6ae8fa874f5e57c81` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:56.434969 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7b6e4-a40e-4bd3-b140-ea50c7a1bf8f None admin] RBAC: Authorizing `identity:get_user(user_id=bc35680d2f4f44f6ae8fa874f5e57c81)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:56.436408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7b6e4-a40e-4bd3-b140-ea50c7a1bf8f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:56.438287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 77/146] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:56 2022] GET /identity/v3/users/bc35680d2f4f44f6ae8fa874f5e57c81 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:56.443796 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63313c72-be26-4648-a4c6-43280133fc52 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:56.492614 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:56.584510 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63313c72-be26-4648-a4c6-43280133fc52 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:56.623533 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ad236-6564-4bbb-9c64-696031b01102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:56.624391 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ad236-6564-4bbb-9c64-696031b01102 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:56.624669 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ad236-6564-4bbb-9c64-696031b01102 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:56.624938 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ad236-6564-4bbb-9c64-696031b01102 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:56.626161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ad236-6564-4bbb-9c64-696031b01102 None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:56.627649 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ad236-6564-4bbb-9c64-696031b01102 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:56.629368 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 70/147] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:56 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:56.635211 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7b6e4-a40e-4bd3-b140-ea50c7a1bf8f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:56.773424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7b6e4-a40e-4bd3-b140-ea50c7a1bf8f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:56.809481 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91b09e-06c9-4bce-9c20-ebd99e3b50a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:56.810758 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b09e-06c9-4bce-9c20-ebd99e3b50a2 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:56.811259 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b09e-06c9-4bce-9c20-ebd99e3b50a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:56.811734 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91b09e-06c9-4bce-9c20-ebd99e3b50a2 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13/users/bc35680d2f4f44f6ae8fa874f5e57c81/roles/b74601dfd03749c3a08d4097fc9c2868` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:56.814768 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91b09e-06c9-4bce-9c20-ebd99e3b50a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7415ae7a8bf412685572674e06f9d13, user_id=bc35680d2f4f44f6ae8fa874f5e57c81, role_id=b74601dfd03749c3a08d4097fc9c2868)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:56.816469 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91b09e-06c9-4bce-9c20-ebd99e3b50a2 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:56.835043 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 78/148] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:41:56 2022] PUT /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13/users/bc35680d2f4f44f6ae8fa874f5e57c81/roles/b74601dfd03749c3a08d4097fc9c2868 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:41:57.201645 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de096f-be76-4e4d-b0eb-80245db7a1f8 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:57.202676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de096f-be76-4e4d-b0eb-80245db7a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:57.203168 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de096f-be76-4e4d-b0eb-80245db7a1f8 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:57.204799 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 71/149] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:57.210447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161625c-2f8f-46ff-ae6c-9f9fa03ffced None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:57.210939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161625c-2f8f-46ff-ae6c-9f9fa03ffced None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:57.211015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161625c-2f8f-46ff-ae6c-9f9fa03ffced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:57.228667 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-6161625c-2f8f-46ff-ae6c-9f9fa03ffced None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:57.230588 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-6161625c-2f8f-46ff-ae6c-9f9fa03ffced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:57.243145 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:57.310287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 79/150] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:57.353043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de096f-be76-4e4d-b0eb-80245db7a1f8 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:57.492825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:57.505721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de096f-be76-4e4d-b0eb-80245db7a1f8 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:57.544545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef801051-09e7-4b56-ac0d-9c4035fb28c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:57.545378 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef801051-09e7-4b56-ac0d-9c4035fb28c2 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:57.545660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef801051-09e7-4b56-ac0d-9c4035fb28c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:57.545932 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef801051-09e7-4b56-ac0d-9c4035fb28c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:57.566192 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef801051-09e7-4b56-ac0d-9c4035fb28c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-ef801051-09e7-4b56-ac0d-9c4035fb28c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:57.574398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:57.575245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:41:57.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 72/151] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:41:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:57.583192 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161625c-2f8f-46ff-ae6c-9f9fa03ffced None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:57.750220 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6161625c-2f8f-46ff-ae6c-9f9fa03ffced None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:57.794091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2636b2b-a05f-4883-9049-082d7e77ee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:57.794764 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2636b2b-a05f-4883-9049-082d7e77ee5a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:57.795044 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2636b2b-a05f-4883-9049-082d7e77ee5a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:57.795317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2636b2b-a05f-4883-9049-082d7e77ee5a None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:57.796061 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2636b2b-a05f-4883-9049-082d7e77ee5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:57.796366 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2636b2b-a05f-4883-9049-082d7e77ee5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:57.801889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2636b2b-a05f-4883-9049-082d7e77ee5a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:57.811107 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 80/152] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:41:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:57.816825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef801051-09e7-4b56-ac0d-9c4035fb28c2 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:57.967429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36e46-e1ba-45f7-b4b3-b7ef0a732016 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:57.967943 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36e46-e1ba-45f7-b4b3-b7ef0a732016 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:57.968429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd36e46-e1ba-45f7-b4b3-b7ef0a732016 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:57.973668 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 81/153] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:57.982698 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae70397-fbdf-48de-8967-fb0adfe6e00b None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:57.983232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae70397-fbdf-48de-8967-fb0adfe6e00b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:57.983770 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae70397-fbdf-48de-8967-fb0adfe6e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:57.993332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef801051-09e7-4b56-ac0d-9c4035fb28c2 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:58.011193 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-6ae70397-fbdf-48de-8967-fb0adfe6e00b None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:58.012685 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-6ae70397-fbdf-48de-8967-fb0adfe6e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:58.021308 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:58.053855 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec84b-b0a7-4ae0-ae8c-a491c5e94717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:58.054732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec84b-b0a7-4ae0-ae8c-a491c5e94717 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:58.055012 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec84b-b0a7-4ae0-ae8c-a491c5e94717 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:58.055285 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec84b-b0a7-4ae0-ae8c-a491c5e94717 None admin] PATH_INFO: `/v3/users/0fbe2a791a454dbc9269f301d02d0d98` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:58.056475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacec84b-b0a7-4ae0-ae8c-a491c5e94717 None admin] RBAC: Authorizing `identity:get_user(user_id=0fbe2a791a454dbc9269f301d02d0d98)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:58.057961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacec84b-b0a7-4ae0-ae8c-a491c5e94717 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:58.059587 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 73/154] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:57 2022] GET /identity/v3/users/0fbe2a791a454dbc9269f301d02d0d98 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:58.066018 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec84b-b0a7-4ae0-ae8c-a491c5e94717 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:58.102825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:58.178839 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 82/155] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:58.232332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec84b-b0a7-4ae0-ae8c-a491c5e94717 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:58.242692 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae70397-fbdf-48de-8967-fb0adfe6e00b None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:58.312893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3467259a-4268-49db-8b3f-26a6ebc47570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:58.314454 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467259a-4268-49db-8b3f-26a6ebc47570 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:58.314933 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467259a-4268-49db-8b3f-26a6ebc47570 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:58.315404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3467259a-4268-49db-8b3f-26a6ebc47570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:58.389692 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467259a-4268-49db-8b3f-26a6ebc47570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:58.391588 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3467259a-4268-49db-8b3f-26a6ebc47570 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:58.413195 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:58.465327 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae70397-fbdf-48de-8967-fb0adfe6e00b None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:58.504844 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 74/156] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:41:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:41:58.506658 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe606c7-9fc4-4ef1-a5cc-8317a4bdad3a None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:58.507221 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe606c7-9fc4-4ef1-a5cc-8317a4bdad3a None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:58.507692 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe606c7-9fc4-4ef1-a5cc-8317a4bdad3a None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:58.509177 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 75/157] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:58.510600 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe606c7-9fc4-4ef1-a5cc-8317a4bdad3a None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:58.550014 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ec99f-155c-4e1b-bf4b-f61bdd398862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:58.550825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ec99f-155c-4e1b-bf4b-f61bdd398862 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:58.551112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ec99f-155c-4e1b-bf4b-f61bdd398862 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:58.551390 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ec99f-155c-4e1b-bf4b-f61bdd398862 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:58.570772 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:58.576878 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ec99f-155c-4e1b-bf4b-f61bdd398862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-747ec99f-155c-4e1b-bf4b-f61bdd398862 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:58.584782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:58.585809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:58.586581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:41:58.590447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 83/158] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:58.591638 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c970-438a-4368-af07-58ace6d49ce2 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:58.591930 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c970-438a-4368-af07-58ace6d49ce2 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:58.592213 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48c970-438a-4368-af07-58ace6d49ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:58.628391 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe606c7-9fc4-4ef1-a5cc-8317a4bdad3a None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:58.630375 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-7e48c970-438a-4368-af07-58ace6d49ce2 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:58.632073 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-7e48c970-438a-4368-af07-58ace6d49ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:58.647734 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:58.668429 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14ea8b-1289-439f-a200-29adf9619611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:58.669683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14ea8b-1289-439f-a200-29adf9619611 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:58.670163 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14ea8b-1289-439f-a200-29adf9619611 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:58.670670 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14ea8b-1289-439f-a200-29adf9619611 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:58.672128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14ea8b-1289-439f-a200-29adf9619611 None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:58.674373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14ea8b-1289-439f-a200-29adf9619611 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:58.676416 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 76/159] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:41:58 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:41:58.677416 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14ea8b-1289-439f-a200-29adf9619611 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:58.785130 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14ea8b-1289-439f-a200-29adf9619611 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:58.804743 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 84/160] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:58.805640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48c970-438a-4368-af07-58ace6d49ce2 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:58.821984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df653930-779c-4c11-8215-af0e229d7f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:58.822927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df653930-779c-4c11-8215-af0e229d7f85 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:58.823422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df653930-779c-4c11-8215-af0e229d7f85 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:58.829817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df653930-779c-4c11-8215-af0e229d7f85 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:58.830899 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df653930-779c-4c11-8215-af0e229d7f85 None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:58.831433 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df653930-779c-4c11-8215-af0e229d7f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:58.833051 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df653930-779c-4c11-8215-af0e229d7f85 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:58.842190 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 77/161] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:41:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:58.843769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199335f-56fe-4f65-9fb7-dfac0f952287 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:58.844271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199335f-56fe-4f65-9fb7-dfac0f952287 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:58.844826 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199335f-56fe-4f65-9fb7-dfac0f952287 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:58.846920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 78/162] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:41:58.853611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199335f-56fe-4f65-9fb7-dfac0f952287 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:58.995296 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:59.060898 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48c970-438a-4368-af07-58ace6d49ce2 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:59.118443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:59.119975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199335f-56fe-4f65-9fb7-dfac0f952287 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:59.132034 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a000b7b-1e24-4995-af7a-9f96f3051e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:59.133022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000b7b-1e24-4995-af7a-9f96f3051e48 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:59.133517 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000b7b-1e24-4995-af7a-9f96f3051e48 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:59.134003 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a000b7b-1e24-4995-af7a-9f96f3051e48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:59.135032 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a000b7b-1e24-4995-af7a-9f96f3051e48 None admin] RBAC: Adding query filter params (role.id=3ca3c240900e4ca5865d244abf112295, scope.project.id=e7415ae7a8bf412685572674e06f9d13, user.id=0fbe2a791a454dbc9269f301d02d0d98) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:41:59.135593 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a000b7b-1e24-4995-af7a-9f96f3051e48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:59.137201 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a000b7b-1e24-4995-af7a-9f96f3051e48 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:59.147659 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 85/163] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:41:58 2022] GET /identity/v3/role_assignments?user.id=0fbe2a791a454dbc9269f301d02d0d98&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=3ca3c240900e4ca5865d244abf112295 => generated 608 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:59.149547 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a000b7b-1e24-4995-af7a-9f96f3051e48 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:59.186264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e2a15-c609-42aa-8fa6-62a1fd0530ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:59.188486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2a15-c609-42aa-8fa6-62a1fd0530ac None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:59.192345 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2a15-c609-42aa-8fa6-62a1fd0530ac None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:59.192880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2a15-c609-42aa-8fa6-62a1fd0530ac None admin] PATH_INFO: `/v3/users/0fbe2a791a454dbc9269f301d02d0d98` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:59.194397 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e2a15-c609-42aa-8fa6-62a1fd0530ac None admin] RBAC: Authorizing `identity:get_user(user_id=0fbe2a791a454dbc9269f301d02d0d98)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:59.196029 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e2a15-c609-42aa-8fa6-62a1fd0530ac None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:59.198994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 79/164] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:41:58 2022] GET /identity/v3/users/0fbe2a791a454dbc9269f301d02d0d98 => generated 275 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:41:59.202315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbe779-6244-49db-a8f5-242932c9e2c5 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:59.203698 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbe779-6244-49db-a8f5-242932c9e2c5 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:59.205451 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbe779-6244-49db-a8f5-242932c9e2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:59.234999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-04fbe779-6244-49db-a8f5-242932c9e2c5 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:41:59.237016 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-04fbe779-6244-49db-a8f5-242932c9e2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:41:59.360259 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a000b7b-1e24-4995-af7a-9f96f3051e48 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:59.407674 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 80/165] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:41:59.408859 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbe779-6244-49db-a8f5-242932c9e2c5 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:59.454564 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb7e4f-f263-4686-81fd-1b4aa5b13c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:59.455375 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7e4f-f263-4686-81fd-1b4aa5b13c58 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:59.455657 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7e4f-f263-4686-81fd-1b4aa5b13c58 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:59.455935 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb7e4f-f263-4686-81fd-1b4aa5b13c58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:59.482949 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb7e4f-f263-4686-81fd-1b4aa5b13c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-b7cb7e4f-f263-4686-81fd-1b4aa5b13c58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:59.503317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:59.504255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:41:59.505012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 86/166] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:41:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:59.505914 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb7e4f-f263-4686-81fd-1b4aa5b13c58 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:59.513664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:59.607547 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbe779-6244-49db-a8f5-242932c9e2c5 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:59.625631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:59.666458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ad7fc-f9d4-4df1-8aa8-f298792b365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:59.667040 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad7fc-f9d4-4df1-8aa8-f298792b365e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:59.667320 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad7fc-f9d4-4df1-8aa8-f298792b365e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:59.667595 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ad7fc-f9d4-4df1-8aa8-f298792b365e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:59.711148 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb7e4f-f263-4686-81fd-1b4aa5b13c58 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:41:59.764710 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ad7fc-f9d4-4df1-8aa8-f298792b365e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:41:59.766227 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ad7fc-f9d4-4df1-8aa8-f298792b365e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:41:59.780300 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408517-9b74-4996-9785-eddacf0276ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:41:59.781395 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408517-9b74-4996-9785-eddacf0276ba None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:41:59.781677 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408517-9b74-4996-9785-eddacf0276ba None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:41:59.781956 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4408517-9b74-4996-9785-eddacf0276ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:41:59.805773 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4408517-9b74-4996-9785-eddacf0276ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-b4408517-9b74-4996-9785-eddacf0276ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:41:59.813608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:41:59.815000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:41:59.815765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 87/167] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:41:59.816413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408517-9b74-4996-9785-eddacf0276ba None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:41:59.865703 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:59.982222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 81/168] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:41:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:41:59.983082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ad7fc-f9d4-4df1-8aa8-f298792b365e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:00.009257 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4408517-9b74-4996-9785-eddacf0276ba None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:00.038137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:00.061984 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfddfc9-907b-4e9a-9af2-9eef4bde378b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:00.062657 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfddfc9-907b-4e9a-9af2-9eef4bde378b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:00.062942 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfddfc9-907b-4e9a-9af2-9eef4bde378b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:00.063222 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfddfc9-907b-4e9a-9af2-9eef4bde378b None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:00.064010 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfddfc9-907b-4e9a-9af2-9eef4bde378b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:00.064320 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfddfc9-907b-4e9a-9af2-9eef4bde378b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:00.065736 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfddfc9-907b-4e9a-9af2-9eef4bde378b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:00.076942 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 88/169] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:41:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:00.078086 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfddfc9-907b-4e9a-9af2-9eef4bde378b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:00.152175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ad7fc-f9d4-4df1-8aa8-f298792b365e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:00.196293 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9407d10-0ecd-4c66-aa35-cb905b48e813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:00.197369 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9407d10-0ecd-4c66-aa35-cb905b48e813 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:00.197873 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9407d10-0ecd-4c66-aa35-cb905b48e813 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:00.198347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9407d10-0ecd-4c66-aa35-cb905b48e813 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:00.200321 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9407d10-0ecd-4c66-aa35-cb905b48e813 None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:00.203937 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9407d10-0ecd-4c66-aa35-cb905b48e813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:00.206103 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9407d10-0ecd-4c66-aa35-cb905b48e813 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:00.224858 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 82/170] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:41:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:00.227829 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9407d10-0ecd-4c66-aa35-cb905b48e813 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:00.256540 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:00.303128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfddfc9-907b-4e9a-9af2-9eef4bde378b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:00.398681 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91a74b-e7a7-446b-a58e-5fc95c83f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:00.399613 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91a74b-e7a7-446b-a58e-5fc95c83f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:00.399902 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91a74b-e7a7-446b-a58e-5fc95c83f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:00.400181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91a74b-e7a7-446b-a58e-5fc95c83f0d4 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:00.406337 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91a74b-e7a7-446b-a58e-5fc95c83f0d4 None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:00.407156 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9407d10-0ecd-4c66-aa35-cb905b48e813 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:00.407855 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91a74b-e7a7-446b-a58e-5fc95c83f0d4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:00.409665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 89/171] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:00 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:00.410975 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f722d4-999e-4df0-a8eb-69565a0ed2a4 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:00.411181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f722d4-999e-4df0-a8eb-69565a0ed2a4 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:00.411461 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f722d4-999e-4df0-a8eb-69565a0ed2a4 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:00.412710 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 90/172] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:00.421529 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f722d4-999e-4df0-a8eb-69565a0ed2a4 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:00.455291 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f59b96-a35e-4b9c-82d9-543cd3c9d400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:00.456756 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59b96-a35e-4b9c-82d9-543cd3c9d400 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:00.458789 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59b96-a35e-4b9c-82d9-543cd3c9d400 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:00.459276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f59b96-a35e-4b9c-82d9-543cd3c9d400 None admin] PATH_INFO: `/v3/users/ca16bce227ff43aa8e414592d2c86bfd` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:00.464996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f59b96-a35e-4b9c-82d9-543cd3c9d400 None admin] RBAC: Authorizing `identity:get_user(user_id=ca16bce227ff43aa8e414592d2c86bfd)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:00.466759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f59b96-a35e-4b9c-82d9-543cd3c9d400 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:00.468659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 83/173] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:00 2022] GET /identity/v3/users/ca16bce227ff43aa8e414592d2c86bfd => generated 247 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:00.471042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f59b96-a35e-4b9c-82d9-543cd3c9d400 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:00.521181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:00.564885 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:00.599821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f59b96-a35e-4b9c-82d9-543cd3c9d400 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:00.636861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f722d4-999e-4df0-a8eb-69565a0ed2a4 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:00.650830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5b21-4431-4a06-a1bd-7cbc7735ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:00.651972 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5b21-4431-4a06-a1bd-7cbc7735ce36 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:00.653874 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5b21-4431-4a06-a1bd-7cbc7735ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:00.654512 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5b21-4431-4a06-a1bd-7cbc7735ce36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:00.655755 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d5b21-4431-4a06-a1bd-7cbc7735ce36 None admin] RBAC: Adding query filter params (role.id=a6f65f08e2fc407cad745e9cd18f282d, scope.project.id=e7415ae7a8bf412685572674e06f9d13, user.id=0fbe2a791a454dbc9269f301d02d0d98) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:00.656721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d5b21-4431-4a06-a1bd-7cbc7735ce36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:00.659881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d5b21-4431-4a06-a1bd-7cbc7735ce36 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:00.672585 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 84/174] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:00 2022] GET /identity/v3/role_assignments?user.id=0fbe2a791a454dbc9269f301d02d0d98&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:00.675928 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee5e3-211a-4571-ba49-3a0c4c7a8ecc None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:00.679390 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee5e3-211a-4571-ba49-3a0c4c7a8ecc None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:00.679946 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ee5e3-211a-4571-ba49-3a0c4c7a8ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:00.719578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-6c7ee5e3-211a-4571-ba49-3a0c4c7a8ecc None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:00.722531 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-6c7ee5e3-211a-4571-ba49-3a0c4c7a8ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:00.724150 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83983c51-c8b9-40c7-b858-207aec2f9980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:00.725349 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983c51-c8b9-40c7-b858-207aec2f9980 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:00.725837 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983c51-c8b9-40c7-b858-207aec2f9980 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:00.726307 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983c51-c8b9-40c7-b858-207aec2f9980 None admin] PATH_INFO: `/v3/users/0fbe2a791a454dbc9269f301d02d0d98` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:00.730458 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83983c51-c8b9-40c7-b858-207aec2f9980 None admin] RBAC: Authorizing `identity:get_user(user_id=0fbe2a791a454dbc9269f301d02d0d98)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:00.732284 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83983c51-c8b9-40c7-b858-207aec2f9980 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:00.734361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 91/175] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:00 2022] GET /identity/v3/users/0fbe2a791a454dbc9269f301d02d0d98 => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:00.737984 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83983c51-c8b9-40c7-b858-207aec2f9980 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:00.897456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 85/176] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:00.898402 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ee5e3-211a-4571-ba49-3a0c4c7a8ecc None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:00.933891 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83983c51-c8b9-40c7-b858-207aec2f9980 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:00.945728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:00.980090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3006d-0c95-44c1-9602-94681b484fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:00.980746 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3006d-0c95-44c1-9602-94681b484fea None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:00.981030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3006d-0c95-44c1-9602-94681b484fea None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:00.981330 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3006d-0c95-44c1-9602-94681b484fea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:00.984395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:01.015577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ee5e3-211a-4571-ba49-3a0c4c7a8ecc None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:01.048845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e72bf-f10b-4915-9fbe-a5e0e5dde987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:01.049836 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e72bf-f10b-4915-9fbe-a5e0e5dde987 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.049836 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e72bf-f10b-4915-9fbe-a5e0e5dde987 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.050177 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e72bf-f10b-4915-9fbe-a5e0e5dde987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.050290 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3006d-0c95-44c1-9602-94681b484fea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:01.051820 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3006d-0c95-44c1-9602-94681b484fea None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:01.117308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e72bf-f10b-4915-9fbe-a5e0e5dde987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:01.118792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e72bf-f10b-4915-9fbe-a5e0e5dde987 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:01.147587 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 92/177] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:01.148829 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc052f4-d2e1-4c9e-a6f4-de1ae873a53f None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.149119 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc052f4-d2e1-4c9e-a6f4-de1ae873a53f None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.149438 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc052f4-d2e1-4c9e-a6f4-de1ae873a53f None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.150719 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 93/178] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:01.154641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a88b36-a6f6-41dd-9eb2-aef89d7c9c0a None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.155083 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a88b36-a6f6-41dd-9eb2-aef89d7c9c0a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.155421 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a88b36-a6f6-41dd-9eb2-aef89d7c9c0a None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.156953 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 94/179] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:01.158365 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a88b36-a6f6-41dd-9eb2-aef89d7c9c0a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:01.170569 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:01.191091 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:01.225450 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 86/180] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:01.225450 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5f8e-24dd-4b6b-812a-57e90eb64fbb None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.225738 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5f8e-24dd-4b6b-812a-57e90eb64fbb None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.225854 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eda5f8e-24dd-4b6b-812a-57e90eb64fbb None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.227216 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 87/181] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:01.227945 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda5f8e-24dd-4b6b-812a-57e90eb64fbb None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:01.266489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a88b36-a6f6-41dd-9eb2-aef89d7c9c0a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:01.301949 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94b89c-5059-499c-80ca-1973350ccc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:01.302733 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94b89c-5059-499c-80ca-1973350ccc91 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.303018 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94b89c-5059-499c-80ca-1973350ccc91 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.303293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94b89c-5059-499c-80ca-1973350ccc91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.313375 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94b89c-5059-499c-80ca-1973350ccc91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-1e94b89c-5059-499c-80ca-1973350ccc91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:01.321560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:01.322489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:01.323293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 95/182] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:01.323959 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa6873-0a87-4d10-8d50-590ee9810ade None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.324227 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa6873-0a87-4d10-8d50-590ee9810ade None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.324491 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa6873-0a87-4d10-8d50-590ee9810ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.335233 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eda5f8e-24dd-4b6b-812a-57e90eb64fbb None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:01.340673 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-fefa6873-0a87-4d10-8d50-590ee9810ade None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:01.341899 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-fefa6873-0a87-4d10-8d50-590ee9810ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:01.367709 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03f7ab-b87e-4151-901c-8c07d238f16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:01.368593 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f7ab-b87e-4151-901c-8c07d238f16c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.368908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f7ab-b87e-4151-901c-8c07d238f16c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.369192 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f7ab-b87e-4151-901c-8c07d238f16c None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.370408 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03f7ab-b87e-4151-901c-8c07d238f16c None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:01.371841 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03f7ab-b87e-4151-901c-8c07d238f16c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:01.373603 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 88/183] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:01 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:01.381179 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9cb33-954a-482f-8d21-0677aec61864 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.381526 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9cb33-954a-482f-8d21-0677aec61864 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.381837 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9cb33-954a-482f-8d21-0677aec61864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.397844 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-0de9cb33-954a-482f-8d21-0677aec61864 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:01.398947 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-0de9cb33-954a-482f-8d21-0677aec61864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:01.403117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:01.410252 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 96/184] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:01.411061 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa6873-0a87-4d10-8d50-590ee9810ade None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:01.430512 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:01.467895 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 89/185] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:01.469331 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56993e1-9001-4287-8e5e-ae1b916fea4d None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.469488 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56993e1-9001-4287-8e5e-ae1b916fea4d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.469767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56993e1-9001-4287-8e5e-ae1b916fea4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.487068 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-a56993e1-9001-4287-8e5e-ae1b916fea4d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:01.487218 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-a56993e1-9001-4287-8e5e-ae1b916fea4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:01.515403 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa6873-0a87-4d10-8d50-590ee9810ade None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:01.550643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe46acd-0aa9-4f25-b8ac-bad8d2b7fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:01.551494 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe46acd-0aa9-4f25-b8ac-bad8d2b7fef3 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.551774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe46acd-0aa9-4f25-b8ac-bad8d2b7fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.552048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe46acd-0aa9-4f25-b8ac-bad8d2b7fef3 None admin] PATH_INFO: `/v3/projects/d352f855ddb54a81b0093f8f65a06c55` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.553218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe46acd-0aa9-4f25-b8ac-bad8d2b7fef3 None admin] RBAC: Authorizing `identity:get_project(project_id=d352f855ddb54a81b0093f8f65a06c55)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:01.554670 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe46acd-0aa9-4f25-b8ac-bad8d2b7fef3 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:01.556386 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 97/186] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:01 2022] GET /identity/v3/projects/d352f855ddb54a81b0093f8f65a06c55 => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:01.557215 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe46acd-0aa9-4f25-b8ac-bad8d2b7fef3 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:01.562068 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 90/187] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:01.562907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56993e1-9001-4287-8e5e-ae1b916fea4d None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:01.629667 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:01.657977 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:01.661812 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe46acd-0aa9-4f25-b8ac-bad8d2b7fef3 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:01.662242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56993e1-9001-4287-8e5e-ae1b916fea4d None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:01.696064 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd08daf-4459-491f-88e4-f0b949568a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:01.696849 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd08daf-4459-491f-88e4-f0b949568a31 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.697408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd08daf-4459-491f-88e4-f0b949568a31 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.697698 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd08daf-4459-491f-88e4-f0b949568a31 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.698443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd08daf-4459-491f-88e4-f0b949568a31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:01.698746 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd08daf-4459-491f-88e4-f0b949568a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:01.699818 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4a42e-6963-4da6-bf52-546089dc0b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:01.700106 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd08daf-4459-491f-88e4-f0b949568a31 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:01.700468 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4a42e-6963-4da6-bf52-546089dc0b38 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.700751 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4a42e-6963-4da6-bf52-546089dc0b38 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.701023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4a42e-6963-4da6-bf52-546089dc0b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.701881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4a42e-6963-4da6-bf52-546089dc0b38 None admin] RBAC: Adding query filter params (role.id=948b82ff28c547e78755c196cddfdd0e, scope.project.id=e7415ae7a8bf412685572674e06f9d13, user.id=ca16bce227ff43aa8e414592d2c86bfd) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:01.702559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4a42e-6963-4da6-bf52-546089dc0b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:01.703620 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4a42e-6963-4da6-bf52-546089dc0b38 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:01.713439 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 98/188] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:01.713609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 91/189] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:01 2022] GET /identity/v3/role_assignments?user.id=ca16bce227ff43aa8e414592d2c86bfd&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=948b82ff28c547e78755c196cddfdd0e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:01.713687 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd08daf-4459-491f-88e4-f0b949568a31 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:01.713755 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4a42e-6963-4da6-bf52-546089dc0b38 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:01.825131 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4a42e-6963-4da6-bf52-546089dc0b38 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:01.831864 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd08daf-4459-491f-88e4-f0b949568a31 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:01.864647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:01.869047 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade42ff6-d705-4c0e-9e83-71a7fdedcdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:01.869908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade42ff6-d705-4c0e-9e83-71a7fdedcdf8 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.870197 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade42ff6-d705-4c0e-9e83-71a7fdedcdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.870459 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade42ff6-d705-4c0e-9e83-71a7fdedcdf8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.871289 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d721fd-10b7-4d12-a31c-7f5baf069866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:01.872614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d721fd-10b7-4d12-a31c-7f5baf069866 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:01.873564 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d721fd-10b7-4d12-a31c-7f5baf069866 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:01.873671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d721fd-10b7-4d12-a31c-7f5baf069866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:01.874991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d721fd-10b7-4d12-a31c-7f5baf069866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:01.876480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d721fd-10b7-4d12-a31c-7f5baf069866 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:01.878567 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 99/190] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:01.884217 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d721fd-10b7-4d12-a31c-7f5baf069866 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:01.884331 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade42ff6-d705-4c0e-9e83-71a7fdedcdf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-ade42ff6-d705-4c0e-9e83-71a7fdedcdf8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:01.894031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:01.894984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:01.895774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:01.896385 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 92/191] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:42:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:01.896923 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade42ff6-d705-4c0e-9e83-71a7fdedcdf8 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:01.924474 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:01.997544 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d721fd-10b7-4d12-a31c-7f5baf069866 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.006731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade42ff6-d705-4c0e-9e83-71a7fdedcdf8 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.029635 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529994e-fe00-4068-9d2b-f877298cd8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.030278 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529994e-fe00-4068-9d2b-f877298cd8fd None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.030557 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529994e-fe00-4068-9d2b-f877298cd8fd None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.030834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529994e-fe00-4068-9d2b-f877298cd8fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.031902 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529994e-fe00-4068-9d2b-f877298cd8fd None admin] RBAC: Adding query filter params (role.id=a6f65f08e2fc407cad745e9cd18f282d, scope.project.id=d352f855ddb54a81b0093f8f65a06c55, user.id=0fbe2a791a454dbc9269f301d02d0d98) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:02.032209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529994e-fe00-4068-9d2b-f877298cd8fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:02.034228 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f529994e-fe00-4068-9d2b-f877298cd8fd None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:02.040015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 100/192] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:01 2022] GET /identity/v3/role_assignments?user.id=0fbe2a791a454dbc9269f301d02d0d98&scope.project.id=d352f855ddb54a81b0093f8f65a06c55&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:02.040125 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb0225-7ec9-4b71-8f92-8473bd8d3826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.040692 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529994e-fe00-4068-9d2b-f877298cd8fd None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:02.040881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0225-7ec9-4b71-8f92-8473bd8d3826 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.041121 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0225-7ec9-4b71-8f92-8473bd8d3826 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.041434 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb0225-7ec9-4b71-8f92-8473bd8d3826 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.059851 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb0225-7ec9-4b71-8f92-8473bd8d3826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-8dcb0225-7ec9-4b71-8f92-8473bd8d3826 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:02.068615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:02.069639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:02.070430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 93/193] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:02.071083 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb0225-7ec9-4b71-8f92-8473bd8d3826 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:02.119447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:02.163916 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529994e-fe00-4068-9d2b-f877298cd8fd None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.172938 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:02.195141 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb0225-7ec9-4b71-8f92-8473bd8d3826 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.200465 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd452fd4-b739-4456-9bd4-cac09311d55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.201394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd452fd4-b739-4456-9bd4-cac09311d55d None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.201676 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd452fd4-b739-4456-9bd4-cac09311d55d None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.201945 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd452fd4-b739-4456-9bd4-cac09311d55d None admin] PATH_INFO: `/v3/users/206e35bdd3544a159dc388dbbeb2369c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.218881 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd452fd4-b739-4456-9bd4-cac09311d55d None admin] RBAC: Authorizing `identity:get_user(user_id=206e35bdd3544a159dc388dbbeb2369c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:02.220244 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd452fd4-b739-4456-9bd4-cac09311d55d None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:02.221701 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 101/194] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:02 2022] GET /identity/v3/users/206e35bdd3544a159dc388dbbeb2369c => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:02.222541 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd452fd4-b739-4456-9bd4-cac09311d55d None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:02.235948 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961e21-c498-4d33-8844-b13cd5d4746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.236676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961e21-c498-4d33-8844-b13cd5d4746f None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.236962 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961e21-c498-4d33-8844-b13cd5d4746f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.237238 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961e21-c498-4d33-8844-b13cd5d4746f None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.238042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51961e21-c498-4d33-8844-b13cd5d4746f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:02.239621 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51961e21-c498-4d33-8844-b13cd5d4746f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:02.262423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 94/195] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:42:02 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:42:02.263262 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961e21-c498-4d33-8844-b13cd5d4746f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:02.349378 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd452fd4-b739-4456-9bd4-cac09311d55d None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.371184 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:02.387408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831248f6-ec20-4ce7-a24f-8bcc9fc49b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.388081 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831248f6-ec20-4ce7-a24f-8bcc9fc49b68 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.388361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831248f6-ec20-4ce7-a24f-8bcc9fc49b68 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.388638 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831248f6-ec20-4ce7-a24f-8bcc9fc49b68 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.389420 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831248f6-ec20-4ce7-a24f-8bcc9fc49b68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:02.389728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831248f6-ec20-4ce7-a24f-8bcc9fc49b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:02.391111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831248f6-ec20-4ce7-a24f-8bcc9fc49b68 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:02.394064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961e21-c498-4d33-8844-b13cd5d4746f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.401138 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 102/196] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:02.406908 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831248f6-ec20-4ce7-a24f-8bcc9fc49b68 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:02.431681 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9563d40-6c6a-459c-bf3d-5cad2dacec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.432528 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9563d40-6c6a-459c-bf3d-5cad2dacec3b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.432807 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9563d40-6c6a-459c-bf3d-5cad2dacec3b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.433082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9563d40-6c6a-459c-bf3d-5cad2dacec3b None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.433868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9563d40-6c6a-459c-bf3d-5cad2dacec3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:02.434178 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9563d40-6c6a-459c-bf3d-5cad2dacec3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:02.435562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9563d40-6c6a-459c-bf3d-5cad2dacec3b None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:02.441702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:02.447137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 95/197] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:02.447959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9563d40-6c6a-459c-bf3d-5cad2dacec3b None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:02.532589 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831248f6-ec20-4ce7-a24f-8bcc9fc49b68 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.578318 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed049e5-8225-41d2-9edb-1396fd407e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.578965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed049e5-8225-41d2-9edb-1396fd407e85 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.579287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed049e5-8225-41d2-9edb-1396fd407e85 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.579560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed049e5-8225-41d2-9edb-1396fd407e85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.580890 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9563d40-6c6a-459c-bf3d-5cad2dacec3b None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.621956 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66e0cf-855d-42a7-bf70-1ac5b6051271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.622823 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66e0cf-855d-42a7-bf70-1ac5b6051271 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.623100 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66e0cf-855d-42a7-bf70-1ac5b6051271 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.623369 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66e0cf-855d-42a7-bf70-1ac5b6051271 None admin] PATH_INFO: `/v3/users/206e35bdd3544a159dc388dbbeb2369c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.624548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66e0cf-855d-42a7-bf70-1ac5b6051271 None admin] RBAC: Authorizing `identity:get_user(user_id=206e35bdd3544a159dc388dbbeb2369c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:02.626011 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66e0cf-855d-42a7-bf70-1ac5b6051271 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:02.628362 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 96/198] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:02 2022] GET /identity/v3/users/206e35bdd3544a159dc388dbbeb2369c => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:02.632936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66e0cf-855d-42a7-bf70-1ac5b6051271 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:02.636787 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:02.660991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed049e5-8225-41d2-9edb-1396fd407e85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:02.663058 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed049e5-8225-41d2-9edb-1396fd407e85 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:02.713704 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:02.755173 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66e0cf-855d-42a7-bf70-1ac5b6051271 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.792595 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e16a-5f1f-43d1-9f71-4b6f3f4d5011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.793533 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e16a-5f1f-43d1-9f71-4b6f3f4d5011 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.793866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e16a-5f1f-43d1-9f71-4b6f3f4d5011 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.794145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e16a-5f1f-43d1-9f71-4b6f3f4d5011 None admin] PATH_INFO: `/v3/users/bc35680d2f4f44f6ae8fa874f5e57c81` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.795370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9e16a-5f1f-43d1-9f71-4b6f3f4d5011 None admin] RBAC: Authorizing `identity:get_user(user_id=bc35680d2f4f44f6ae8fa874f5e57c81)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:02.795693 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 103/199] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:02.796732 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed049e5-8225-41d2-9edb-1396fd407e85 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:02.796836 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9e16a-5f1f-43d1-9f71-4b6f3f4d5011 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:02.799258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 97/200] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:02 2022] GET /identity/v3/users/bc35680d2f4f44f6ae8fa874f5e57c81 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:02.806272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e16a-5f1f-43d1-9f71-4b6f3f4d5011 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:02.905687 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:02.925178 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed049e5-8225-41d2-9edb-1396fd407e85 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.929617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e16a-5f1f-43d1-9f71-4b6f3f4d5011 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:02.966639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d977d6d-28df-4524-8fed-be06afb9afea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.967468 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977d6d-28df-4524-8fed-be06afb9afea None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.967755 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977d6d-28df-4524-8fed-be06afb9afea None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.968029 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977d6d-28df-4524-8fed-be06afb9afea None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.968288 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae5f9e-0605-4360-ae0b-c3d5896bb4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:02.969135 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae5f9e-0605-4360-ae0b-c3d5896bb4da None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:02.969237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d977d6d-28df-4524-8fed-be06afb9afea None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:02.969722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae5f9e-0605-4360-ae0b-c3d5896bb4da None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:02.970691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae5f9e-0605-4360-ae0b-c3d5896bb4da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:02.971515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d977d6d-28df-4524-8fed-be06afb9afea None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:02.979235 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 98/201] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:02 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:02.979235 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d977d6d-28df-4524-8fed-be06afb9afea None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:02.982285 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:03.059869 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae5f9e-0605-4360-ae0b-c3d5896bb4da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:03.061480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae5f9e-0605-4360-ae0b-c3d5896bb4da None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:03.103251 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d977d6d-28df-4524-8fed-be06afb9afea None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:03.140436 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdcfb3-4f63-43b2-8b6b-03cfc328962f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:03.141509 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdcfb3-4f63-43b2-8b6b-03cfc328962f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:03.142040 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdcfb3-4f63-43b2-8b6b-03cfc328962f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:03.142511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdcfb3-4f63-43b2-8b6b-03cfc328962f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:03.163201 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:03.185175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 104/202] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:03.190463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae5f9e-0605-4360-ae0b-c3d5896bb4da None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:03.215194 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdcfb3-4f63-43b2-8b6b-03cfc328962f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:03.217172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdcfb3-4f63-43b2-8b6b-03cfc328962f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:03.220684 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:03.299621 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae5f9e-0605-4360-ae0b-c3d5896bb4da None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:03.319628 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 99/203] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:03.320581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdcfb3-4f63-43b2-8b6b-03cfc328962f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:03.337182 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d6024-0fda-4809-b873-0ba9e238d229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:03.338064 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d6024-0fda-4809-b873-0ba9e238d229 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:03.338512 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d6024-0fda-4809-b873-0ba9e238d229 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:03.338929 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d6024-0fda-4809-b873-0ba9e238d229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:03.340033 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d6024-0fda-4809-b873-0ba9e238d229 None admin] RBAC: Adding query filter params (role.id=948b82ff28c547e78755c196cddfdd0e, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c, user.id=206e35bdd3544a159dc388dbbeb2369c) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:03.340580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d6024-0fda-4809-b873-0ba9e238d229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:03.342175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d6024-0fda-4809-b873-0ba9e238d229 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:03.348830 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 105/204] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:03 2022] GET /identity/v3/role_assignments?user.id=206e35bdd3544a159dc388dbbeb2369c&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=948b82ff28c547e78755c196cddfdd0e => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:03.349819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d6024-0fda-4809-b873-0ba9e238d229 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:03.404702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:03.456469 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdcfb3-4f63-43b2-8b6b-03cfc328962f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:03.458943 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:03.467452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d6024-0fda-4809-b873-0ba9e238d229 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:03.494785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f241b-367c-4e63-a580-0c79b14e69d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:03.495650 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f241b-367c-4e63-a580-0c79b14e69d0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:03.495938 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f241b-367c-4e63-a580-0c79b14e69d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:03.496419 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f241b-367c-4e63-a580-0c79b14e69d0 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:03.497419 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f241b-367c-4e63-a580-0c79b14e69d0 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:03.498927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f241b-367c-4e63-a580-0c79b14e69d0 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:03.500590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 100/205] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:03 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:03.506639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f241b-367c-4e63-a580-0c79b14e69d0 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:03.508550 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6a6ee-9bdf-46b9-a0aa-e92706f0cbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:03.518264 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6a6ee-9bdf-46b9-a0aa-e92706f0cbe4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:03.518973 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6a6ee-9bdf-46b9-a0aa-e92706f0cbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:03.519559 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6a6ee-9bdf-46b9-a0aa-e92706f0cbe4 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:03.522430 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6a6ee-9bdf-46b9-a0aa-e92706f0cbe4 None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:03.524872 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6a6ee-9bdf-46b9-a0aa-e92706f0cbe4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:03.527551 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 106/206] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:03 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:03.536299 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6a6ee-9bdf-46b9-a0aa-e92706f0cbe4 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:03.648728 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f241b-367c-4e63-a580-0c79b14e69d0 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:03.703761 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348610-6504-4298-93ee-556838e3d62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:03.705046 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348610-6504-4298-93ee-556838e3d62b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:03.705569 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348610-6504-4298-93ee-556838e3d62b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:03.705843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348610-6504-4298-93ee-556838e3d62b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:03.706676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348610-6504-4298-93ee-556838e3d62b None admin] RBAC: Adding query filter params (role.id=3ca3c240900e4ca5865d244abf112295, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c, user.id=206e35bdd3544a159dc388dbbeb2369c) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:03.706983 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348610-6504-4298-93ee-556838e3d62b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:03.708438 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348610-6504-4298-93ee-556838e3d62b None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:03.723418 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 101/207] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:03 2022] GET /identity/v3/role_assignments?user.id=206e35bdd3544a159dc388dbbeb2369c&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=3ca3c240900e4ca5865d244abf112295 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:03.744929 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6a6ee-9bdf-46b9-a0aa-e92706f0cbe4 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:03.781670 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:03.806071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c37f9c-b3bb-4402-8758-a70d3fdc0730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:03.806805 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c37f9c-b3bb-4402-8758-a70d3fdc0730 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:03.807092 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c37f9c-b3bb-4402-8758-a70d3fdc0730 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:03.807368 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c37f9c-b3bb-4402-8758-a70d3fdc0730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:03.808227 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c37f9c-b3bb-4402-8758-a70d3fdc0730 None admin] RBAC: Adding query filter params (role.id=b74601dfd03749c3a08d4097fc9c2868, scope.project.id=e7415ae7a8bf412685572674e06f9d13, user.id=bc35680d2f4f44f6ae8fa874f5e57c81) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:03.808541 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c37f9c-b3bb-4402-8758-a70d3fdc0730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:03.810118 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c37f9c-b3bb-4402-8758-a70d3fdc0730 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:03.817998 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 107/208] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:03 2022] GET /identity/v3/role_assignments?user.id=bc35680d2f4f44f6ae8fa874f5e57c81&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=b74601dfd03749c3a08d4097fc9c2868 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:04.853315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123f4b3-65ca-49a5-b03d-875a054c65d1 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:04.853834 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123f4b3-65ca-49a5-b03d-875a054c65d1 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:04.854160 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123f4b3-65ca-49a5-b03d-875a054c65d1 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:04.855872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 102/209] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:04.866524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10722438-1a97-4a40-80af-ee4e4e43f6e8 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:04.866962 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10722438-1a97-4a40-80af-ee4e4e43f6e8 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:04.867288 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10722438-1a97-4a40-80af-ee4e4e43f6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:04.887979 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-10722438-1a97-4a40-80af-ee4e4e43f6e8 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:04.889196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-10722438-1a97-4a40-80af-ee4e4e43f6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:04.906293 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ae39a-576a-432f-8612-94c99359429a None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:04.906863 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ae39a-576a-432f-8612-94c99359429a None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:04.907415 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29ae39a-576a-432f-8612-94c99359429a None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:04.908987 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 103/210] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:42:04.916380 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bc35a-0e31-4a82-ad53-3395af76a528 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:04.917223 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bc35a-0e31-4a82-ad53-3395af76a528 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:04.918054 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bc35a-0e31-4a82-ad53-3395af76a528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:04.936870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-928bc35a-0e31-4a82-ad53-3395af76a528 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:04.938567 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-928bc35a-0e31-4a82-ad53-3395af76a528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:04.962464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 108/211] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:04.970171 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:04.988220 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10722438-1a97-4a40-80af-ee4e4e43f6e8 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.011531 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 104/212] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:05.040660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bc35a-0e31-4a82-ad53-3395af76a528 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.093565 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10722438-1a97-4a40-80af-ee4e4e43f6e8 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.104700 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:05.133653 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863901bf-6f51-4b5e-8ab4-a5d438a9f220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.134953 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863901bf-6f51-4b5e-8ab4-a5d438a9f220 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.135747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863901bf-6f51-4b5e-8ab4-a5d438a9f220 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.136125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863901bf-6f51-4b5e-8ab4-a5d438a9f220 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.151290 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863901bf-6f51-4b5e-8ab4-a5d438a9f220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-863901bf-6f51-4b5e-8ab4-a5d438a9f220 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:05.160103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:05.161154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:05.162187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:05.163318 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bc35a-0e31-4a82-ad53-3395af76a528 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.168847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 109/213] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:05.169944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863901bf-6f51-4b5e-8ab4-a5d438a9f220 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.212215 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8e3e8-38b0-4a34-afed-8236be3313a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.214563 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8e3e8-38b0-4a34-afed-8236be3313a6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.215009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8e3e8-38b0-4a34-afed-8236be3313a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.215434 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8e3e8-38b0-4a34-afed-8236be3313a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.216825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8e3e8-38b0-4a34-afed-8236be3313a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.218458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8e3e8-38b0-4a34-afed-8236be3313a6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.221369 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 105/214] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:05.227310 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8e3e8-38b0-4a34-afed-8236be3313a6 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.270268 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:05.306827 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863901bf-6f51-4b5e-8ab4-a5d438a9f220 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.343371 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faec56-3541-4b9a-9376-56139765f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.344368 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faec56-3541-4b9a-9376-56139765f896 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.345406 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faec56-3541-4b9a-9376-56139765f896 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.345884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faec56-3541-4b9a-9376-56139765f896 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.346842 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faec56-3541-4b9a-9376-56139765f896 None admin] RBAC: Adding query filter params (name=member) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:05.347492 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faec56-3541-4b9a-9376-56139765f896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.349120 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8faec56-3541-4b9a-9376-56139765f896 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.353384 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8e3e8-38b0-4a34-afed-8236be3313a6 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.358654 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 110/215] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:05.366794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faec56-3541-4b9a-9376-56139765f896 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.398859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:05.402904 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51456cf-af0b-43c9-aa19-c09961acdd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.403667 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51456cf-af0b-43c9-aa19-c09961acdd57 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.404037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51456cf-af0b-43c9-aa19-c09961acdd57 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.404385 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51456cf-af0b-43c9-aa19-c09961acdd57 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.405433 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51456cf-af0b-43c9-aa19-c09961acdd57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.409209 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51456cf-af0b-43c9-aa19-c09961acdd57 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.436395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 106/216] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:42:05 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:42:05.490220 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faec56-3541-4b9a-9376-56139765f896 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.530467 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5de96-ba8f-4b8e-8b91-9122f1fc9ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.531688 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5de96-ba8f-4b8e-8b91-9122f1fc9ae5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.531972 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5de96-ba8f-4b8e-8b91-9122f1fc9ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.532822 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5de96-ba8f-4b8e-8b91-9122f1fc9ae5 None admin] PATH_INFO: `/v3/users/d61b7fd10fcc406aa1372b966f07bb1f` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.549916 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5de96-ba8f-4b8e-8b91-9122f1fc9ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=d61b7fd10fcc406aa1372b966f07bb1f)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.551390 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5de96-ba8f-4b8e-8b91-9122f1fc9ae5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.553495 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 111/217] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/users/d61b7fd10fcc406aa1372b966f07bb1f => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:05.561174 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51456cf-af0b-43c9-aa19-c09961acdd57 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.665819 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:05.678500 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51456cf-af0b-43c9-aa19-c09961acdd57 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:05.718008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30422017-23dc-460d-8d85-4e2371094bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:05.718736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422017-23dc-460d-8d85-4e2371094bd1 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.719028 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422017-23dc-460d-8d85-4e2371094bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.719306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30422017-23dc-460d-8d85-4e2371094bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.798206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30422017-23dc-460d-8d85-4e2371094bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:05.799689 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30422017-23dc-460d-8d85-4e2371094bd1 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:05.863056 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188806-4c7d-4b2f-8d4d-13ba9158a12d None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.863056 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188806-4c7d-4b2f-8d4d-13ba9158a12d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.863056 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188806-4c7d-4b2f-8d4d-13ba9158a12d None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.864416 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 112/218] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:05.869849 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4416f2f-6b71-46f5-9b8b-f6970fa58ed7 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:05.870441 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4416f2f-6b71-46f5-9b8b-f6970fa58ed7 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:05.870441 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4416f2f-6b71-46f5-9b8b-f6970fa58ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:05.894319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-e4416f2f-6b71-46f5-9b8b-f6970fa58ed7 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:05.895758 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-e4416f2f-6b71-46f5-9b8b-f6970fa58ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:05.913553 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:05.924366 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 107/219] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:05.930821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30422017-23dc-460d-8d85-4e2371094bd1 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:05.975204 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 113/220] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:06.000107 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4416f2f-6b71-46f5-9b8b-f6970fa58ed7 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:06.022026 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:06.043402 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30422017-23dc-460d-8d85-4e2371094bd1 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:06.080970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efd882-2b1b-457a-b436-ecf86548af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:06.082094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efd882-2b1b-457a-b436-ecf86548af23 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.082516 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efd882-2b1b-457a-b436-ecf86548af23 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.082929 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3efd882-2b1b-457a-b436-ecf86548af23 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.084260 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efd882-2b1b-457a-b436-ecf86548af23 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:06.085909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3efd882-2b1b-457a-b436-ecf86548af23 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:06.087750 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 108/221] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:06.094951 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efd882-2b1b-457a-b436-ecf86548af23 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:06.115472 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4416f2f-6b71-46f5-9b8b-f6970fa58ed7 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:06.160753 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fde19-41a2-4b3e-a044-c9b834c348de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:06.161600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fde19-41a2-4b3e-a044-c9b834c348de None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.161884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fde19-41a2-4b3e-a044-c9b834c348de None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.162166 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fde19-41a2-4b3e-a044-c9b834c348de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.163027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:06.178593 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fde19-41a2-4b3e-a044-c9b834c348de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-f55fde19-41a2-4b3e-a044-c9b834c348de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:06.188596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:06.190079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:06.190896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 114/222] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:06.193441 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471674c-3e54-4dd5-ad02-6dd4ab77b076 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.193898 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471674c-3e54-4dd5-ad02-6dd4ab77b076 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.194333 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471674c-3e54-4dd5-ad02-6dd4ab77b076 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.196063 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 115/223] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:06.198143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471674c-3e54-4dd5-ad02-6dd4ab77b076 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:06.219749 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3efd882-2b1b-457a-b436-ecf86548af23 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:06.259332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e00a58-26f0-4498-932e-3a966efd1d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:06.260526 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e00a58-26f0-4498-932e-3a966efd1d5d None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.261005 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e00a58-26f0-4498-932e-3a966efd1d5d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.261576 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e00a58-26f0-4498-932e-3a966efd1d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.262806 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e00a58-26f0-4498-932e-3a966efd1d5d None admin] RBAC: Adding query filter params (role.id=a6f65f08e2fc407cad745e9cd18f282d, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c, user.id=d61b7fd10fcc406aa1372b966f07bb1f) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:06.263409 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e00a58-26f0-4498-932e-3a966efd1d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:06.265127 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e00a58-26f0-4498-932e-3a966efd1d5d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:06.271892 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 109/224] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:06 2022] GET /identity/v3/role_assignments?user.id=d61b7fd10fcc406aa1372b966f07bb1f&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:06.279084 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd26f1-85b1-43f2-ad16-94414589f365 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.279680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd26f1-85b1-43f2-ad16-94414589f365 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.280209 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd26f1-85b1-43f2-ad16-94414589f365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.301706 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:06.312506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-79dd26f1-85b1-43f2-ad16-94414589f365 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:06.312506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-79dd26f1-85b1-43f2-ad16-94414589f365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:06.332616 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471674c-3e54-4dd5-ad02-6dd4ab77b076 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:06.402020 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf41c03-3d35-4ec9-a66b-c0d61f5c584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:06.402690 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41c03-3d35-4ec9-a66b-c0d61f5c584c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.402970 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41c03-3d35-4ec9-a66b-c0d61f5c584c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.403243 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41c03-3d35-4ec9-a66b-c0d61f5c584c None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.403996 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf41c03-3d35-4ec9-a66b-c0d61f5c584c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:06.404298 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf41c03-3d35-4ec9-a66b-c0d61f5c584c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:06.405880 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf41c03-3d35-4ec9-a66b-c0d61f5c584c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:06.425345 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 116/225] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:06.436391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf41c03-3d35-4ec9-a66b-c0d61f5c584c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:06.443099 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 110/226] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:06.478954 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd26f1-85b1-43f2-ad16-94414589f365 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:06.557478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:06.569381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf41c03-3d35-4ec9-a66b-c0d61f5c584c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:06.620996 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf6de4-646e-4575-ae42-23c21a885671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:06.623390 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf6de4-646e-4575-ae42-23c21a885671 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.625465 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf6de4-646e-4575-ae42-23c21a885671 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.626007 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf6de4-646e-4575-ae42-23c21a885671 None admin] PATH_INFO: `/v3/users/206e35bdd3544a159dc388dbbeb2369c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.628437 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf6de4-646e-4575-ae42-23c21a885671 None admin] RBAC: Authorizing `identity:get_user(user_id=206e35bdd3544a159dc388dbbeb2369c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:06.630849 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf6de4-646e-4575-ae42-23c21a885671 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:06.632739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 117/227] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:06 2022] GET /identity/v3/users/206e35bdd3544a159dc388dbbeb2369c => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:06.638035 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf6de4-646e-4575-ae42-23c21a885671 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:06.650676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd26f1-85b1-43f2-ad16-94414589f365 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:06.654825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:06.699898 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7538-55db-46f8-8f06-6d93637e0cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:06.701043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7538-55db-46f8-8f06-6d93637e0cd3 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.701567 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7538-55db-46f8-8f06-6d93637e0cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.702038 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e7538-55db-46f8-8f06-6d93637e0cd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.727292 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e7538-55db-46f8-8f06-6d93637e0cd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-e64e7538-55db-46f8-8f06-6d93637e0cd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:06.736271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:06.737153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:06.737990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 111/228] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:42:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:06.744566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7538-55db-46f8-8f06-6d93637e0cd3 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:06.859513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf6de4-646e-4575-ae42-23c21a885671 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:06.864962 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e7538-55db-46f8-8f06-6d93637e0cd3 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:06.880817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:06.916341 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f751-bb9c-46f8-9a1a-605ac184abd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:06.917809 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f751-bb9c-46f8-9a1a-605ac184abd1 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.918317 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f751-bb9c-46f8-9a1a-605ac184abd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.918786 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9f751-bb9c-46f8-9a1a-605ac184abd1 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.920721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9f751-bb9c-46f8-9a1a-605ac184abd1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:06.921986 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9f751-bb9c-46f8-9a1a-605ac184abd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:06.923850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9f751-bb9c-46f8-9a1a-605ac184abd1 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:06.937097 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac022a34-eb01-4aad-81a1-1082b3adeaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:06.938572 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 112/229] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:06.944289 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f751-bb9c-46f8-9a1a-605ac184abd1 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:06.944792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022a34-eb01-4aad-81a1-1082b3adeaf4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:06.945355 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022a34-eb01-4aad-81a1-1082b3adeaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:06.945859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022a34-eb01-4aad-81a1-1082b3adeaf4 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:06.948393 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac022a34-eb01-4aad-81a1-1082b3adeaf4 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:06.950289 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac022a34-eb01-4aad-81a1-1082b3adeaf4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:06.952233 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 118/230] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:06 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:06.958180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac022a34-eb01-4aad-81a1-1082b3adeaf4 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:07.104054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:07.124491 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9f751-bb9c-46f8-9a1a-605ac184abd1 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:07.148849 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac022a34-eb01-4aad-81a1-1082b3adeaf4 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:07.172427 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f604598-0b36-49ed-bc54-788724f9ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:07.174420 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604598-0b36-49ed-bc54-788724f9ac51 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:07.174934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604598-0b36-49ed-bc54-788724f9ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:07.175408 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f604598-0b36-49ed-bc54-788724f9ac51 None admin] PATH_INFO: `/v3/users/206e35bdd3544a159dc388dbbeb2369c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:07.177040 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f604598-0b36-49ed-bc54-788724f9ac51 None admin] RBAC: Authorizing `identity:get_user(user_id=206e35bdd3544a159dc388dbbeb2369c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:07.178850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f604598-0b36-49ed-bc54-788724f9ac51 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:07.181661 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 113/231] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:06 2022] GET /identity/v3/users/206e35bdd3544a159dc388dbbeb2369c => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:07.194428 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f604598-0b36-49ed-bc54-788724f9ac51 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:07.208896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779160d8-253a-4373-a22d-682bc72d5c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:07.209739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779160d8-253a-4373-a22d-682bc72d5c38 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:07.210069 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779160d8-253a-4373-a22d-682bc72d5c38 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:07.210346 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779160d8-253a-4373-a22d-682bc72d5c38 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/users/206e35bdd3544a159dc388dbbeb2369c/roles/948b82ff28c547e78755c196cddfdd0e` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:07.212730 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779160d8-253a-4373-a22d-682bc72d5c38 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb5c54a62b6d4543b25bbf5d03cd319c, user_id=206e35bdd3544a159dc388dbbeb2369c, role_id=948b82ff28c547e78755c196cddfdd0e)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:07.213940 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779160d8-253a-4373-a22d-682bc72d5c38 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:07.230854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 119/232] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:42:06 2022] PUT /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/users/206e35bdd3544a159dc388dbbeb2369c/roles/948b82ff28c547e78755c196cddfdd0e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:42:07.261713 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:07.321587 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f604598-0b36-49ed-bc54-788724f9ac51 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:07.358130 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6312e4-9534-44a7-9327-e1dc5ae1026f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:07.359059 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6312e4-9534-44a7-9327-e1dc5ae1026f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:07.359642 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6312e4-9534-44a7-9327-e1dc5ae1026f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:07.359975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6312e4-9534-44a7-9327-e1dc5ae1026f None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:07.361220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6312e4-9534-44a7-9327-e1dc5ae1026f None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:07.362755 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6312e4-9534-44a7-9327-e1dc5ae1026f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:07.364460 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 114/233] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:07 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:07.374459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779160d8-253a-4373-a22d-682bc72d5c38 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:07.527050 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779160d8-253a-4373-a22d-682bc72d5c38 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:07.565996 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492a822-7396-4734-9a75-0d93bdf37f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:07.566896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492a822-7396-4734-9a75-0d93bdf37f33 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:07.567178 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492a822-7396-4734-9a75-0d93bdf37f33 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:07.567454 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492a822-7396-4734-9a75-0d93bdf37f33 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/users/206e35bdd3544a159dc388dbbeb2369c/roles/3ca3c240900e4ca5865d244abf112295` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:07.572383 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492a822-7396-4734-9a75-0d93bdf37f33 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb5c54a62b6d4543b25bbf5d03cd319c, user_id=206e35bdd3544a159dc388dbbeb2369c, role_id=3ca3c240900e4ca5865d244abf112295)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:07.574022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492a822-7396-4734-9a75-0d93bdf37f33 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:07.578225 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:07.594843 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 120/234] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:42:07 2022] PUT /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/users/206e35bdd3544a159dc388dbbeb2369c/roles/3ca3c240900e4ca5865d244abf112295 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:08.348676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0267b-7495-4acc-9f5a-a7332f5b9832 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:08.349195 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0267b-7495-4acc-9f5a-a7332f5b9832 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:08.349324 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0267b-7495-4acc-9f5a-a7332f5b9832 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:08.350637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 115/235] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:08.355889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc0c25-07a6-4666-8eb1-1bc7853367ec None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:08.356303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc0c25-07a6-4666-8eb1-1bc7853367ec None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:08.356475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc0c25-07a6-4666-8eb1-1bc7853367ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:08.377205 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-81fc0c25-07a6-4666-8eb1-1bc7853367ec None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:08.378437 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-81fc0c25-07a6-4666-8eb1-1bc7853367ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:08.468119 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 121/236] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:08.516799 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0267b-7495-4acc-9f5a-a7332f5b9832 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:08.651003 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0267b-7495-4acc-9f5a-a7332f5b9832 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:08.664722 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:08.689578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62994ce2-0c0e-4baa-b920-2c0e7c6bf7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:08.690372 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62994ce2-0c0e-4baa-b920-2c0e7c6bf7f6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:08.690653 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62994ce2-0c0e-4baa-b920-2c0e7c6bf7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:08.690925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62994ce2-0c0e-4baa-b920-2c0e7c6bf7f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:08.701422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62994ce2-0c0e-4baa-b920-2c0e7c6bf7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-62994ce2-0c0e-4baa-b920-2c0e7c6bf7f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:08.709116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:08.710031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:08.710825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 116/237] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:08.718373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc0c25-07a6-4666-8eb1-1bc7853367ec None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:08.797304 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbc3a-5f78-4947-9243-0cbc2bdc157c None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:08.797710 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbc3a-5f78-4947-9243-0cbc2bdc157c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:08.798428 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdbc3a-5f78-4947-9243-0cbc2bdc157c None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:08.800226 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 117/238] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:08.811211 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82b59d-84f1-4d5b-b526-57282d8c0618 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:08.811505 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82b59d-84f1-4d5b-b526-57282d8c0618 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:08.811750 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82b59d-84f1-4d5b-b526-57282d8c0618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:08.836502 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-7b82b59d-84f1-4d5b-b526-57282d8c0618 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:08.837724 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-7b82b59d-84f1-4d5b-b526-57282d8c0618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:08.903451 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc0c25-07a6-4666-8eb1-1bc7853367ec None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:08.928209 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 118/239] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 12 18:42:08.955562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82b59d-84f1-4d5b-b526-57282d8c0618 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:08.962122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:08.972929 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43eafc-a428-4a1c-9760-c9c1fcf0f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:08.973804 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43eafc-a428-4a1c-9760-c9c1fcf0f816 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:08.974245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43eafc-a428-4a1c-9760-c9c1fcf0f816 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:08.974654 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43eafc-a428-4a1c-9760-c9c1fcf0f816 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:08.975581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43eafc-a428-4a1c-9760-c9c1fcf0f816 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:08.976020 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43eafc-a428-4a1c-9760-c9c1fcf0f816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:08.977612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43eafc-a428-4a1c-9760-c9c1fcf0f816 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:08.988496 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 122/240] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:08.990486 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82e63-06ed-47ad-a0e0-c99afb88a284 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:08.991243 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82e63-06ed-47ad-a0e0-c99afb88a284 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:08.991799 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f82e63-06ed-47ad-a0e0-c99afb88a284 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:08.993813 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 123/241] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:08.995004 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f82e63-06ed-47ad-a0e0-c99afb88a284 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:09.080868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:09.084164 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82b59d-84f1-4d5b-b526-57282d8c0618 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:09.118243 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f82e63-06ed-47ad-a0e0-c99afb88a284 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:09.125337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd65bb9-454d-4206-be66-4eb1a46ecc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:09.126722 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65bb9-454d-4206-be66-4eb1a46ecc2e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:09.127192 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65bb9-454d-4206-be66-4eb1a46ecc2e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:09.127626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65bb9-454d-4206-be66-4eb1a46ecc2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:09.129309 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd65bb9-454d-4206-be66-4eb1a46ecc2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:09.131489 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd65bb9-454d-4206-be66-4eb1a46ecc2e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:09.133453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 119/242] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:09.135550 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb172da-4280-41f2-a55d-e062e08e0245 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:09.136016 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb172da-4280-41f2-a55d-e062e08e0245 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:09.136591 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb172da-4280-41f2-a55d-e062e08e0245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:09.156212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfeb6c-4507-4f42-8888-4ed83a6bbb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:09.157948 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-fbb172da-4280-41f2-a55d-e062e08e0245 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:09.158151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfeb6c-4507-4f42-8888-4ed83a6bbb58 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:09.158596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfeb6c-4507-4f42-8888-4ed83a6bbb58 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:09.159036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfeb6c-4507-4f42-8888-4ed83a6bbb58 None admin] PATH_INFO: `/v3/users/67f0ce213a60409fa67cab7504aaba2f` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:09.159573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-fbb172da-4280-41f2-a55d-e062e08e0245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:09.174235 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfeb6c-4507-4f42-8888-4ed83a6bbb58 None admin] RBAC: Authorizing `identity:get_user(user_id=67f0ce213a60409fa67cab7504aaba2f)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:09.176156 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfeb6c-4507-4f42-8888-4ed83a6bbb58 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:09.178129 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 124/243] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:08 2022] GET /identity/v3/users/67f0ce213a60409fa67cab7504aaba2f => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:09.179221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfeb6c-4507-4f42-8888-4ed83a6bbb58 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:09.229451 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:09.233427 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 120/244] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:09.234636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb172da-4280-41f2-a55d-e062e08e0245 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:09.314510 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfeb6c-4507-4f42-8888-4ed83a6bbb58 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:09.345587 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:09.350116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb172da-4280-41f2-a55d-e062e08e0245 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:09.353223 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dbdee-cc79-4054-a8f6-5c17eca5c9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:09.354375 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dbdee-cc79-4054-a8f6-5c17eca5c9a2 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:09.355825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dbdee-cc79-4054-a8f6-5c17eca5c9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:09.356303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6dbdee-cc79-4054-a8f6-5c17eca5c9a2 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:09.357635 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dbdee-cc79-4054-a8f6-5c17eca5c9a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:09.359309 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6dbdee-cc79-4054-a8f6-5c17eca5c9a2 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:09.381576 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 125/245] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:42:09 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:42:09.382880 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dbdee-cc79-4054-a8f6-5c17eca5c9a2 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:09.390423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba72e-467f-4e38-864b-a59f21ab610d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:09.391185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba72e-467f-4e38-864b-a59f21ab610d None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:09.392078 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba72e-467f-4e38-864b-a59f21ab610d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:09.392357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ba72e-467f-4e38-864b-a59f21ab610d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:09.474034 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ba72e-467f-4e38-864b-a59f21ab610d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:09.475579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ba72e-467f-4e38-864b-a59f21ab610d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:09.499500 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6dbdee-cc79-4054-a8f6-5c17eca5c9a2 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:09.501436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:09.547404 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4e50-7f4d-4ab1-886a-7e8c399c822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:09.548642 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4e50-7f4d-4ab1-886a-7e8c399c822f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:09.549068 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4e50-7f4d-4ab1-886a-7e8c399c822f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:09.549522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee4e50-7f4d-4ab1-886a-7e8c399c822f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:09.561891 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee4e50-7f4d-4ab1-886a-7e8c399c822f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-1fee4e50-7f4d-4ab1-886a-7e8c399c822f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:09.570919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:09.571853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:09.572640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:09.575236 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 126/246] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:09.582224 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4e50-7f4d-4ab1-886a-7e8c399c822f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:09.590963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:09.595902 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 121/247] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:09.601650 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba72e-467f-4e38-864b-a59f21ab610d None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:09.696933 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee4e50-7f4d-4ab1-886a-7e8c399c822f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:09.734829 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a44883-7bac-4de3-bdb2-5a712dc0f1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:09.735985 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44883-7bac-4de3-bdb2-5a712dc0f1b2 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:09.736489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44883-7bac-4de3-bdb2-5a712dc0f1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:09.736960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a44883-7bac-4de3-bdb2-5a712dc0f1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:09.738026 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a44883-7bac-4de3-bdb2-5a712dc0f1b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:09.738393 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ba72e-467f-4e38-864b-a59f21ab610d None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:09.738757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a44883-7bac-4de3-bdb2-5a712dc0f1b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:09.740433 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a44883-7bac-4de3-bdb2-5a712dc0f1b2 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:09.749800 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 127/248] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:09.756122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a44883-7bac-4de3-bdb2-5a712dc0f1b2 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:09.776793 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130adb3-dc78-4dd6-8105-13f48f0f765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:09.777742 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130adb3-dc78-4dd6-8105-13f48f0f765c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:09.778069 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130adb3-dc78-4dd6-8105-13f48f0f765c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:09.778337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130adb3-dc78-4dd6-8105-13f48f0f765c None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:09.779611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130adb3-dc78-4dd6-8105-13f48f0f765c None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:09.781550 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130adb3-dc78-4dd6-8105-13f48f0f765c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:09.783749 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 122/249] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:09 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:09.787437 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:09.791405 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130adb3-dc78-4dd6-8105-13f48f0f765c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:09.870148 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:09.890426 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a44883-7bac-4de3-bdb2-5a712dc0f1b2 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:09.909704 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130adb3-dc78-4dd6-8105-13f48f0f765c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:09.930715 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c94fa0-e5f9-4b4e-ab25-3837a42323fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:09.932046 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c94fa0-e5f9-4b4e-ab25-3837a42323fe None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:09.932594 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c94fa0-e5f9-4b4e-ab25-3837a42323fe None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:09.933064 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c94fa0-e5f9-4b4e-ab25-3837a42323fe None admin] PATH_INFO: `/v3/users/d61b7fd10fcc406aa1372b966f07bb1f` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:09.934540 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c94fa0-e5f9-4b4e-ab25-3837a42323fe None admin] RBAC: Authorizing `identity:get_user(user_id=d61b7fd10fcc406aa1372b966f07bb1f)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:09.936409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c94fa0-e5f9-4b4e-ab25-3837a42323fe None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:09.939015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 128/250] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:09 2022] GET /identity/v3/users/d61b7fd10fcc406aa1372b966f07bb1f => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:09.945584 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c94fa0-e5f9-4b4e-ab25-3837a42323fe None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:09.947245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a397007-aba8-4ba9-84ec-92b6cd83ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:09.947901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a397007-aba8-4ba9-84ec-92b6cd83ef9f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:09.948181 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a397007-aba8-4ba9-84ec-92b6cd83ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:09.948453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a397007-aba8-4ba9-84ec-92b6cd83ef9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:09.949310 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a397007-aba8-4ba9-84ec-92b6cd83ef9f None admin] RBAC: Adding query filter params (role.id=b74601dfd03749c3a08d4097fc9c2868, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c, user.id=67f0ce213a60409fa67cab7504aaba2f) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:09.949732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a397007-aba8-4ba9-84ec-92b6cd83ef9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:09.951491 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a397007-aba8-4ba9-84ec-92b6cd83ef9f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:09.957576 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 123/251] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:09 2022] GET /identity/v3/role_assignments?user.id=67f0ce213a60409fa67cab7504aaba2f&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=b74601dfd03749c3a08d4097fc9c2868 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:10.039885 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0c9dd-57b3-4d09-9167-e828cc748007 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:10.040175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0c9dd-57b3-4d09-9167-e828cc748007 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:10.040356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0c9dd-57b3-4d09-9167-e828cc748007 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:10.046391 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 124/252] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:10.052772 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:10.053544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3c41-e469-4585-abed-6a37edec1f89 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:10.053838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3c41-e469-4585-abed-6a37edec1f89 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:10.054327 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3c41-e469-4585-abed-6a37edec1f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:10.064005 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c94fa0-e5f9-4b4e-ab25-3837a42323fe None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:10.086322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-e3cb3c41-e469-4585-abed-6a37edec1f89 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:10.087710 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-e3cb3c41-e469-4585-abed-6a37edec1f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:10.117091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91f637-b171-4f3d-9a06-5d3af93427e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:10.118464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f637-b171-4f3d-9a06-5d3af93427e3 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:10.122320 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f637-b171-4f3d-9a06-5d3af93427e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:10.122614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f637-b171-4f3d-9a06-5d3af93427e3 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:10.124299 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91f637-b171-4f3d-9a06-5d3af93427e3 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:10.126661 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91f637-b171-4f3d-9a06-5d3af93427e3 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:10.128935 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 129/253] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:09 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:10.135170 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91f637-b171-4f3d-9a06-5d3af93427e3 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:10.201636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 125/254] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:10.230062 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb3c41-e469-4585-abed-6a37edec1f89 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:10.285166 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91f637-b171-4f3d-9a06-5d3af93427e3 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:10.323466 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:10.329608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2856d90-f928-460a-8abb-f4c6306155cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:10.330615 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2856d90-f928-460a-8abb-f4c6306155cb None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:10.330991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2856d90-f928-460a-8abb-f4c6306155cb None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:10.331359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2856d90-f928-460a-8abb-f4c6306155cb None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/users/d61b7fd10fcc406aa1372b966f07bb1f/roles/a6f65f08e2fc407cad745e9cd18f282d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:10.333461 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2856d90-f928-460a-8abb-f4c6306155cb None admin] RBAC: Authorizing `identity:create_grant(project_id=eb5c54a62b6d4543b25bbf5d03cd319c, user_id=d61b7fd10fcc406aa1372b966f07bb1f, role_id=a6f65f08e2fc407cad745e9cd18f282d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:10.334988 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2856d90-f928-460a-8abb-f4c6306155cb None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:10.372138 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 130/255] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:42:10 2022] PUT /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/users/d61b7fd10fcc406aa1372b966f07bb1f/roles/a6f65f08e2fc407cad745e9cd18f282d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:42:10.376679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb3c41-e469-4585-abed-6a37edec1f89 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:10.417395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747d56b-1dcc-4a44-ab0b-c4757bdbceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:10.418446 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d56b-1dcc-4a44-ab0b-c4757bdbceff None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:10.418916 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d56b-1dcc-4a44-ab0b-c4757bdbceff None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:10.419326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747d56b-1dcc-4a44-ab0b-c4757bdbceff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:10.432296 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747d56b-1dcc-4a44-ab0b-c4757bdbceff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-c747d56b-1dcc-4a44-ab0b-c4757bdbceff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:10.441172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:10.442334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:10.443337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:10.445909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 126/256] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:42:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:10.455064 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2856d90-f928-460a-8abb-f4c6306155cb None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:10.490364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:10.598485 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2856d90-f928-460a-8abb-f4c6306155cb None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:10.648638 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce474ab-40c6-49cb-b872-37028fd19afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:10.649396 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce474ab-40c6-49cb-b872-37028fd19afe None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:10.649685 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce474ab-40c6-49cb-b872-37028fd19afe None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:10.649968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce474ab-40c6-49cb-b872-37028fd19afe None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:10.650859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce474ab-40c6-49cb-b872-37028fd19afe None admin] RBAC: Adding query filter params (name=admin) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:10.651211 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce474ab-40c6-49cb-b872-37028fd19afe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:10.652667 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce474ab-40c6-49cb-b872-37028fd19afe None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:10.667167 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 131/257] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:10.673677 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747d56b-1dcc-4a44-ab0b-c4757bdbceff None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:10.689333 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816740e-176b-4e75-8d75-7616bc0e09bb None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:10.689659 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816740e-176b-4e75-8d75-7616bc0e09bb None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:10.689880 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816740e-176b-4e75-8d75-7616bc0e09bb None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:10.691624 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 132/258] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:42:10.697103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd08d8-4e54-4853-b6c4-aaee878e7665 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:10.697417 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd08d8-4e54-4853-b6c4-aaee878e7665 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:10.697861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd08d8-4e54-4853-b6c4-aaee878e7665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:10.720351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-19cd08d8-4e54-4853-b6c4-aaee878e7665 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:10.721900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-19cd08d8-4e54-4853-b6c4-aaee878e7665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:10.843816 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747d56b-1dcc-4a44-ab0b-c4757bdbceff None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:10.862898 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 133/259] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:10.883066 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:10.903409 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe245-8940-4035-9f0f-bd50c0aa15e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:10.904291 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe245-8940-4035-9f0f-bd50c0aa15e3 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:10.904572 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe245-8940-4035-9f0f-bd50c0aa15e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:10.904849 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40fe245-8940-4035-9f0f-bd50c0aa15e3 None admin] PATH_INFO: `/v3/users/206e35bdd3544a159dc388dbbeb2369c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:10.910045 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fe245-8940-4035-9f0f-bd50c0aa15e3 None admin] RBAC: Authorizing `identity:get_user(user_id=206e35bdd3544a159dc388dbbeb2369c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:10.911513 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40fe245-8940-4035-9f0f-bd50c0aa15e3 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:10.913385 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 127/260] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:10 2022] GET /identity/v3/users/206e35bdd3544a159dc388dbbeb2369c => generated 283 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:10.918810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd08d8-4e54-4853-b6c4-aaee878e7665 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:10.929054 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe245-8940-4035-9f0f-bd50c0aa15e3 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:10.941659 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:11.073059 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd08d8-4e54-4853-b6c4-aaee878e7665 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:11.123821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40fe245-8940-4035-9f0f-bd50c0aa15e3 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:11.124816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfb9df-8a0b-434d-b2b6-1b07e5e85bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:11.125496 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfb9df-8a0b-434d-b2b6-1b07e5e85bb0 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:11.125809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfb9df-8a0b-434d-b2b6-1b07e5e85bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:11.126085 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfb9df-8a0b-434d-b2b6-1b07e5e85bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:11.194115 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a8ea0-b0b9-49ba-ac5d-cb7845bbd4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:11.195366 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a8ea0-b0b9-49ba-ac5d-cb7845bbd4ca None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:11.195861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a8ea0-b0b9-49ba-ac5d-cb7845bbd4ca None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:11.196331 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a8ea0-b0b9-49ba-ac5d-cb7845bbd4ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:11.226209 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a8ea0-b0b9-49ba-ac5d-cb7845bbd4ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:11.237224 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfb9df-8a0b-434d-b2b6-1b07e5e85bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:11.237224 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfb9df-8a0b-434d-b2b6-1b07e5e85bb0 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-ba2a8ea0-b0b9-49ba-ac5d-cb7845bbd4ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:11.238881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:11.239773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:11.240566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 128/261] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:42:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:11.250502 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a8ea0-b0b9-49ba-ac5d-cb7845bbd4ca None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:11.276128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:11.373429 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:11.478937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 134/262] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:11.484757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfb9df-8a0b-434d-b2b6-1b07e5e85bb0 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:11.487172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a8ea0-b0b9-49ba-ac5d-cb7845bbd4ca None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:11.564425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eb04c-4b0e-4c83-b9b8-757a45819899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:11.565493 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eb04c-4b0e-4c83-b9b8-757a45819899 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:11.566105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eb04c-4b0e-4c83-b9b8-757a45819899 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:11.566593 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eb04c-4b0e-4c83-b9b8-757a45819899 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:11.567539 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eb04c-4b0e-4c83-b9b8-757a45819899 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:11.568040 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eb04c-4b0e-4c83-b9b8-757a45819899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:11.569648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eb04c-4b0e-4c83-b9b8-757a45819899 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:11.588433 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 129/263] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:11.593904 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eb04c-4b0e-4c83-b9b8-757a45819899 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:11.686120 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfb9df-8a0b-434d-b2b6-1b07e5e85bb0 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:11.713648 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:11.751457 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4a1e5-3e36-4b63-bfb7-af786a967f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:11.752241 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4a1e5-3e36-4b63-bfb7-af786a967f24 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:11.752518 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4a1e5-3e36-4b63-bfb7-af786a967f24 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:11.752801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4a1e5-3e36-4b63-bfb7-af786a967f24 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:11.758032 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4a1e5-3e36-4b63-bfb7-af786a967f24 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:11.759482 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4a1e5-3e36-4b63-bfb7-af786a967f24 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:11.761559 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 135/264] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:11 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:11.769201 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4a1e5-3e36-4b63-bfb7-af786a967f24 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:11.853645 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eb04c-4b0e-4c83-b9b8-757a45819899 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:11.886022 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:11.967245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4a1e5-3e36-4b63-bfb7-af786a967f24 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:11.971030 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d4fa6-f03c-483f-8041-b2479a9400b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:11.972013 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d4fa6-f03c-483f-8041-b2479a9400b4 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:11.972302 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d4fa6-f03c-483f-8041-b2479a9400b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:11.972580 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d4fa6-f03c-483f-8041-b2479a9400b4 None admin] PATH_INFO: `/v3/users/206e35bdd3544a159dc388dbbeb2369c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:11.977984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d4fa6-f03c-483f-8041-b2479a9400b4 None admin] RBAC: Authorizing `identity:get_user(user_id=206e35bdd3544a159dc388dbbeb2369c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:11.979447 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d4fa6-f03c-483f-8041-b2479a9400b4 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:11.981199 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 130/265] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:11 2022] GET /identity/v3/users/206e35bdd3544a159dc388dbbeb2369c => generated 283 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:11.990307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d4fa6-f03c-483f-8041-b2479a9400b4 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:12.027604 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d22ed-efd5-4711-b8cc-73c74e0ce246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:12.028188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d22ed-efd5-4711-b8cc-73c74e0ce246 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:12.028471 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d22ed-efd5-4711-b8cc-73c74e0ce246 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:12.028751 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d22ed-efd5-4711-b8cc-73c74e0ce246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:12.029606 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d22ed-efd5-4711-b8cc-73c74e0ce246 None admin] RBAC: Adding query filter params (role.id=948b82ff28c547e78755c196cddfdd0e, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c, user.id=206e35bdd3544a159dc388dbbeb2369c) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:12.029916 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d22ed-efd5-4711-b8cc-73c74e0ce246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:12.031870 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d22ed-efd5-4711-b8cc-73c74e0ce246 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:12.043339 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 136/266] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:11 2022] GET /identity/v3/role_assignments?user.id=206e35bdd3544a159dc388dbbeb2369c&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=948b82ff28c547e78755c196cddfdd0e => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:12.161899 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d4fa6-f03c-483f-8041-b2479a9400b4 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:12.216468 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260920a3-0b79-44c0-b63c-f7c837d4422d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:12.217545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260920a3-0b79-44c0-b63c-f7c837d4422d None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:12.218029 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260920a3-0b79-44c0-b63c-f7c837d4422d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:12.218522 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260920a3-0b79-44c0-b63c-f7c837d4422d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:12.286511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:12.312979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260920a3-0b79-44c0-b63c-f7c837d4422d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:12.315108 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260920a3-0b79-44c0-b63c-f7c837d4422d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:12.453984 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 131/267] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:12.459237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d22ed-efd5-4711-b8cc-73c74e0ce246 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:12.539691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:12.606966 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d22ed-efd5-4711-b8cc-73c74e0ce246 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:12.652906 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d265d9-53e1-482d-aca6-95e987936383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:12.653791 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d265d9-53e1-482d-aca6-95e987936383 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:12.654074 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d265d9-53e1-482d-aca6-95e987936383 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:12.654348 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d265d9-53e1-482d-aca6-95e987936383 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:12.655546 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d265d9-53e1-482d-aca6-95e987936383 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:12.657820 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d265d9-53e1-482d-aca6-95e987936383 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:12.659839 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 137/268] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:12 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:12.666000 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260920a3-0b79-44c0-b63c-f7c837d4422d None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:12.799526 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:12.825699 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260920a3-0b79-44c0-b63c-f7c837d4422d None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:12.879901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342db481-7837-4fe5-983f-83af6e6631c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:12.879901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db481-7837-4fe5-983f-83af6e6631c2 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:12.879901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db481-7837-4fe5-983f-83af6e6631c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:12.880238 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342db481-7837-4fe5-983f-83af6e6631c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:12.880998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342db481-7837-4fe5-983f-83af6e6631c2 None admin] RBAC: Adding query filter params (role.id=3ca3c240900e4ca5865d244abf112295, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c, user.id=206e35bdd3544a159dc388dbbeb2369c) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:12.881323 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342db481-7837-4fe5-983f-83af6e6631c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:12.884464 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342db481-7837-4fe5-983f-83af6e6631c2 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:12.894200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 132/269] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:12 2022] GET /identity/v3/role_assignments?user.id=206e35bdd3544a159dc388dbbeb2369c&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=3ca3c240900e4ca5865d244abf112295 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:13.253546 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f6faa-d307-42c9-9156-9a50e8cdc715 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.253932 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f6faa-d307-42c9-9156-9a50e8cdc715 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.254109 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f6faa-d307-42c9-9156-9a50e8cdc715 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.255737 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 138/270] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:13.261005 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d898f-5d8b-41d8-80df-6628ffb9a057 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.261327 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d898f-5d8b-41d8-80df-6628ffb9a057 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.261641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d898f-5d8b-41d8-80df-6628ffb9a057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.279481 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-6c2d898f-5d8b-41d8-80df-6628ffb9a057 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:13.280678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-6c2d898f-5d8b-41d8-80df-6628ffb9a057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:13.299460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeacde3-225b-4cb2-9799-83f6cd2a1c28 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.299760 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeacde3-225b-4cb2-9799-83f6cd2a1c28 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.300017 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeacde3-225b-4cb2-9799-83f6cd2a1c28 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.301424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 139/271] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:13.311501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecbbb1-997c-4c58-964d-1fa0af32b80d None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.312300 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecbbb1-997c-4c58-964d-1fa0af32b80d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.312808 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecbbb1-997c-4c58-964d-1fa0af32b80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.345691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-49ecbbb1-997c-4c58-964d-1fa0af32b80d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:13.347447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-49ecbbb1-997c-4c58-964d-1fa0af32b80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:13.385070 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 133/272] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:13.392649 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79277-d546-4576-86ff-e922385a34e0 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.393197 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79277-d546-4576-86ff-e922385a34e0 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.393827 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79277-d546-4576-86ff-e922385a34e0 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.395373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 134/273] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:42:13.401453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1a557-bb71-4239-8c9d-c7374fa9f637 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.402085 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1a557-bb71-4239-8c9d-c7374fa9f637 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.402693 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1a557-bb71-4239-8c9d-c7374fa9f637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.424274 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-39a1a557-bb71-4239-8c9d-c7374fa9f637 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:13.427122 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-39a1a557-bb71-4239-8c9d-c7374fa9f637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:13.443667 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 140/274] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:13.444642 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecbbb1-997c-4c58-964d-1fa0af32b80d None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:13.489022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:13.502051 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 135/275] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:13.506242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1a557-bb71-4239-8c9d-c7374fa9f637 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:13.508687 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:13.549784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecbbb1-997c-4c58-964d-1fa0af32b80d None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:13.582141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa043c-4e10-4137-a2d0-6810473476db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:13.582921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa043c-4e10-4137-a2d0-6810473476db None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.583199 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa043c-4e10-4137-a2d0-6810473476db None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.583475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa043c-4e10-4137-a2d0-6810473476db None admin] PATH_INFO: `/v3/roles/member` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.593253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa043c-4e10-4137-a2d0-6810473476db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-08aa043c-4e10-4137-a2d0-6810473476db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:13.601452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:13.602364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:13.603187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 141/276] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:13.603847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4151-e9b1-4e2b-b0dd-2eb93b5d6d91 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.604134 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4151-e9b1-4e2b-b0dd-2eb93b5d6d91 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.604382 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e4151-e9b1-4e2b-b0dd-2eb93b5d6d91 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.605661 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 142/277] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:13.606351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e4151-e9b1-4e2b-b0dd-2eb93b5d6d91 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:13.612802 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1a557-bb71-4239-8c9d-c7374fa9f637 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:13.648566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145b31f-005b-41f9-9e12-9691054b1d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:13.649398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b31f-005b-41f9-9e12-9691054b1d3f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.649677 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b31f-005b-41f9-9e12-9691054b1d3f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.649958 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b31f-005b-41f9-9e12-9691054b1d3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.660633 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145b31f-005b-41f9-9e12-9691054b1d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-9145b31f-005b-41f9-9e12-9691054b1d3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:13.668328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:13.669805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 136/278] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:13.670686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145b31f-005b-41f9-9e12-9691054b1d3f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:13.709782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e4151-e9b1-4e2b-b0dd-2eb93b5d6d91 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:13.711314 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:13.734751 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:13.745206 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe969842-37ef-45e2-89c2-dacdb2310263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:13.746013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe969842-37ef-45e2-89c2-dacdb2310263 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.746285 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe969842-37ef-45e2-89c2-dacdb2310263 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.746555 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe969842-37ef-45e2-89c2-dacdb2310263 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.747692 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe969842-37ef-45e2-89c2-dacdb2310263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:13.749107 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe969842-37ef-45e2-89c2-dacdb2310263 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:13.750768 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 143/279] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:13.756579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40551ced-8d1b-474e-aaba-958b80382d30 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.756812 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40551ced-8d1b-474e-aaba-958b80382d30 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.757090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40551ced-8d1b-474e-aaba-958b80382d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.772983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-40551ced-8d1b-474e-aaba-958b80382d30 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:13.773934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145b31f-005b-41f9-9e12-9691054b1d3f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:13.774177 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-40551ced-8d1b-474e-aaba-958b80382d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:13.808123 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20947203-67a7-4da9-8879-c54303724c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:13.808778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947203-67a7-4da9-8879-c54303724c74 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.809058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947203-67a7-4da9-8879-c54303724c74 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.809355 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20947203-67a7-4da9-8879-c54303724c74 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.810084 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20947203-67a7-4da9-8879-c54303724c74 None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:13.810383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20947203-67a7-4da9-8879-c54303724c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:13.811741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20947203-67a7-4da9-8879-c54303724c74 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:13.820294 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 137/280] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:13.821246 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20947203-67a7-4da9-8879-c54303724c74 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:13.846180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 144/281] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:13.847006 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40551ced-8d1b-474e-aaba-958b80382d30 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:13.935626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20947203-67a7-4da9-8879-c54303724c74 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:13.947779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:13.950893 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40551ced-8d1b-474e-aaba-958b80382d30 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:13.958461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:13.970189 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb890-36c5-4ea2-b1ac-a7a51c07b3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:13.970841 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb890-36c5-4ea2-b1ac-a7a51c07b3f7 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.971120 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb890-36c5-4ea2-b1ac-a7a51c07b3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.971391 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb890-36c5-4ea2-b1ac-a7a51c07b3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.972124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecb890-36c5-4ea2-b1ac-a7a51c07b3f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:13.972440 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecb890-36c5-4ea2-b1ac-a7a51c07b3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:13.973848 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecb890-36c5-4ea2-b1ac-a7a51c07b3f7 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:13.981586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 138/282] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:13.982349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb890-36c5-4ea2-b1ac-a7a51c07b3f7 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:13.989573 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ef3ea-f717-4265-81b3-c9dd6f0dfa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:13.990240 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ef3ea-f717-4265-81b3-c9dd6f0dfa77 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:13.990525 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ef3ea-f717-4265-81b3-c9dd6f0dfa77 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:13.990805 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ef3ea-f717-4265-81b3-c9dd6f0dfa77 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:13.991538 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ef3ea-f717-4265-81b3-c9dd6f0dfa77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:13.992967 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ef3ea-f717-4265-81b3-c9dd6f0dfa77 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:14.013026 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 145/283] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:42:13 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:42:14.013876 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ef3ea-f717-4265-81b3-c9dd6f0dfa77 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:14.091471 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb890-36c5-4ea2-b1ac-a7a51c07b3f7 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:14.129265 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b701c73-5acc-4289-ab93-ce28a9b8659a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:14.130175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b701c73-5acc-4289-ab93-ce28a9b8659a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:14.130453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b701c73-5acc-4289-ab93-ce28a9b8659a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:14.130723 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b701c73-5acc-4289-ab93-ce28a9b8659a None admin] PATH_INFO: `/v3/users/900ffed08c5f4219a9024ce8035ef81a` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:14.143962 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ef3ea-f717-4265-81b3-c9dd6f0dfa77 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:14.145959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b701c73-5acc-4289-ab93-ce28a9b8659a None admin] RBAC: Authorizing `identity:get_user(user_id=900ffed08c5f4219a9024ce8035ef81a)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:14.147464 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b701c73-5acc-4289-ab93-ce28a9b8659a None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:14.149241 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 139/284] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:13 2022] GET /identity/v3/users/900ffed08c5f4219a9024ce8035ef81a => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:14.149241 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b701c73-5acc-4289-ab93-ce28a9b8659a None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:14.186189 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c8dee-5a83-4e1f-8848-e2e05e2a6672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:14.186990 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c8dee-5a83-4e1f-8848-e2e05e2a6672 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:14.187273 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c8dee-5a83-4e1f-8848-e2e05e2a6672 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:14.187552 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c8dee-5a83-4e1f-8848-e2e05e2a6672 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:14.201682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c8dee-5a83-4e1f-8848-e2e05e2a6672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:14.205269 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-031c8dee-5a83-4e1f-8848-e2e05e2a6672 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:14.211738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:14.212817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:14.213921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 146/285] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:14.218731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c8dee-5a83-4e1f-8848-e2e05e2a6672 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:14.240123 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:14.271093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b701c73-5acc-4289-ab93-ce28a9b8659a None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:14.318008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e4976-8b3f-49f3-89fe-a0fc69903aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:14.318890 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4976-8b3f-49f3-89fe-a0fc69903aba None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:14.319172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4976-8b3f-49f3-89fe-a0fc69903aba None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:14.319448 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e4976-8b3f-49f3-89fe-a0fc69903aba None admin] PATH_INFO: `/v3/users/67f0ce213a60409fa67cab7504aaba2f` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:14.320761 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e4976-8b3f-49f3-89fe-a0fc69903aba None admin] RBAC: Authorizing `identity:get_user(user_id=67f0ce213a60409fa67cab7504aaba2f)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:14.322273 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e4976-8b3f-49f3-89fe-a0fc69903aba None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:14.323912 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 140/286] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:14 2022] GET /identity/v3/users/67f0ce213a60409fa67cab7504aaba2f => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:14.324673 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e4976-8b3f-49f3-89fe-a0fc69903aba None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:14.343272 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c8dee-5a83-4e1f-8848-e2e05e2a6672 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:14.389937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be34fc-183a-48da-ac8d-fb9f9fcf2671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:14.390628 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be34fc-183a-48da-ac8d-fb9f9fcf2671 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:14.390910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be34fc-183a-48da-ac8d-fb9f9fcf2671 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:14.391186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be34fc-183a-48da-ac8d-fb9f9fcf2671 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:14.392049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be34fc-183a-48da-ac8d-fb9f9fcf2671 None admin] RBAC: Adding query filter params (role.id=a6f65f08e2fc407cad745e9cd18f282d, user.id=900ffed08c5f4219a9024ce8035ef81a, scope.system=all) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:14.392359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be34fc-183a-48da-ac8d-fb9f9fcf2671 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:14.393840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be34fc-183a-48da-ac8d-fb9f9fcf2671 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:14.400199 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 147/287] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Jul 12 18:42:14 2022] GET /identity/v3/role_assignments?user.id=900ffed08c5f4219a9024ce8035ef81a&scope.system=all&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:14.400799 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be34fc-183a-48da-ac8d-fb9f9fcf2671 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:14.458647 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e4976-8b3f-49f3-89fe-a0fc69903aba None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:14.478301 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:14.503759 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:14.508211 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c9f65-28ee-4f60-b1cd-9d4ed954805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:14.509051 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c9f65-28ee-4f60-b1cd-9d4ed954805e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:14.509476 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c9f65-28ee-4f60-b1cd-9d4ed954805e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:14.509875 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c9f65-28ee-4f60-b1cd-9d4ed954805e None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:14.510909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c9f65-28ee-4f60-b1cd-9d4ed954805e None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:14.511322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c9f65-28ee-4f60-b1cd-9d4ed954805e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:14.513310 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c9f65-28ee-4f60-b1cd-9d4ed954805e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:14.525170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 141/288] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:14.534097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c9f65-28ee-4f60-b1cd-9d4ed954805e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:14.544318 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be34fc-183a-48da-ac8d-fb9f9fcf2671 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:14.631492 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fc772-3cd1-4865-a813-087fae5a7f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:14.632363 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fc772-3cd1-4865-a813-087fae5a7f06 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:14.632639 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fc772-3cd1-4865-a813-087fae5a7f06 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:14.632905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fc772-3cd1-4865-a813-087fae5a7f06 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:14.634248 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fc772-3cd1-4865-a813-087fae5a7f06 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:14.635709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fc772-3cd1-4865-a813-087fae5a7f06 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:14.638398 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 148/289] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:14 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:14.651472 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fc772-3cd1-4865-a813-087fae5a7f06 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:14.757470 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c9f65-28ee-4f60-b1cd-9d4ed954805e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:14.767604 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fc772-3cd1-4865-a813-087fae5a7f06 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:14.795703 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a17db-2e7c-4180-b0f7-96b1967130b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:14.796499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a17db-2e7c-4180-b0f7-96b1967130b6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:14.796780 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a17db-2e7c-4180-b0f7-96b1967130b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:14.797050 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a17db-2e7c-4180-b0f7-96b1967130b6 None admin] PATH_INFO: `/v3/users/d61b7fd10fcc406aa1372b966f07bb1f` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:14.798308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a17db-2e7c-4180-b0f7-96b1967130b6 None admin] RBAC: Authorizing `identity:get_user(user_id=d61b7fd10fcc406aa1372b966f07bb1f)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:14.799804 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a17db-2e7c-4180-b0f7-96b1967130b6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:14.801466 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 142/290] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:14 2022] GET /identity/v3/users/d61b7fd10fcc406aa1372b966f07bb1f => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:14.806927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a17db-2e7c-4180-b0f7-96b1967130b6 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:14.853947 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:14.865809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee34b20-f9f2-4afd-8a5d-32d92fc482d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:14.866719 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee34b20-f9f2-4afd-8a5d-32d92fc482d4 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:14.867000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee34b20-f9f2-4afd-8a5d-32d92fc482d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:14.867277 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee34b20-f9f2-4afd-8a5d-32d92fc482d4 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/users/67f0ce213a60409fa67cab7504aaba2f/roles/b74601dfd03749c3a08d4097fc9c2868` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:14.870624 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee34b20-f9f2-4afd-8a5d-32d92fc482d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb5c54a62b6d4543b25bbf5d03cd319c, user_id=67f0ce213a60409fa67cab7504aaba2f, role_id=b74601dfd03749c3a08d4097fc9c2868)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:14.875163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee34b20-f9f2-4afd-8a5d-32d92fc482d4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:14.901682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 149/291] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:42:14 2022] PUT /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/users/67f0ce213a60409fa67cab7504aaba2f/roles/b74601dfd03749c3a08d4097fc9c2868 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:42:14.929812 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a17db-2e7c-4180-b0f7-96b1967130b6 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:14.967123 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e1e51-d724-4adc-8a43-8bc88dd62abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:14.967777 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e1e51-d724-4adc-8a43-8bc88dd62abc None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:14.968058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e1e51-d724-4adc-8a43-8bc88dd62abc None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:14.968334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e1e51-d724-4adc-8a43-8bc88dd62abc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:15.043713 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e1e51-d724-4adc-8a43-8bc88dd62abc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:15.045203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e1e51-d724-4adc-8a43-8bc88dd62abc None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:15.092007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:15.151896 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 143/292] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:42:15.158007 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee34b20-f9f2-4afd-8a5d-32d92fc482d4 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:15.169683 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:15.293396 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee34b20-f9f2-4afd-8a5d-32d92fc482d4 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:15.332577 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86e511-3e60-4a5e-9fe6-577d2528ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:15.333482 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86e511-3e60-4a5e-9fe6-577d2528ef28 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:15.333763 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86e511-3e60-4a5e-9fe6-577d2528ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:15.334038 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86e511-3e60-4a5e-9fe6-577d2528ef28 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:15.335219 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86e511-3e60-4a5e-9fe6-577d2528ef28 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:15.336631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86e511-3e60-4a5e-9fe6-577d2528ef28 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:15.344410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 150/293] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:15 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:15.345753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e1e51-d724-4adc-8a43-8bc88dd62abc None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:15.447019 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e1e51-d724-4adc-8a43-8bc88dd62abc None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:15.480914 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603ad45-ce62-4fee-ab19-60b2f7762a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:15.481619 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603ad45-ce62-4fee-ab19-60b2f7762a52 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:15.481899 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603ad45-ce62-4fee-ab19-60b2f7762a52 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:15.482175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603ad45-ce62-4fee-ab19-60b2f7762a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:15.483024 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603ad45-ce62-4fee-ab19-60b2f7762a52 None admin] RBAC: Adding query filter params (role.id=a6f65f08e2fc407cad745e9cd18f282d, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c, user.id=d61b7fd10fcc406aa1372b966f07bb1f) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:15.483335 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603ad45-ce62-4fee-ab19-60b2f7762a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:15.484838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603ad45-ce62-4fee-ab19-60b2f7762a52 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:15.492327 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 144/294] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:15 2022] GET /identity/v3/role_assignments?user.id=d61b7fd10fcc406aa1372b966f07bb1f&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:16.684670 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe2d1a-c591-4d67-b135-07165d283768 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:16.685185 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe2d1a-c591-4d67-b135-07165d283768 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:16.685259 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe2d1a-c591-4d67-b135-07165d283768 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:16.686857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 151/295] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:16.692489 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924b421-1fe2-49bf-8599-99df0d48e7f0 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:16.692889 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924b421-1fe2-49bf-8599-99df0d48e7f0 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:16.693047 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924b421-1fe2-49bf-8599-99df0d48e7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:16.705380 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:16.710997 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-c924b421-1fe2-49bf-8599-99df0d48e7f0 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:16.712186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-c924b421-1fe2-49bf-8599-99df0d48e7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:16.716696 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3991242-47fc-49aa-a51c-1950915b5327 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:16.716984 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3991242-47fc-49aa-a51c-1950915b5327 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:16.717262 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3991242-47fc-49aa-a51c-1950915b5327 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:16.718674 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 152/296] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:42:16.724197 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944baaed-e9d3-447b-869a-6beb1d6e9d95 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:16.724485 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944baaed-e9d3-447b-869a-6beb1d6e9d95 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:16.724761 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944baaed-e9d3-447b-869a-6beb1d6e9d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:16.746866 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-944baaed-e9d3-447b-869a-6beb1d6e9d95 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:16.748037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-944baaed-e9d3-447b-869a-6beb1d6e9d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:16.798053 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 145/297] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:16.821894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924b421-1fe2-49bf-8599-99df0d48e7f0 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:16.827331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 153/298] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:16.854534 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944baaed-e9d3-447b-869a-6beb1d6e9d95 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:16.863620 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:16.939404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c924b421-1fe2-49bf-8599-99df0d48e7f0 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:16.964714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944baaed-e9d3-447b-869a-6beb1d6e9d95 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:16.974680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb911c4b-bb2a-4ec3-ad2f-3e5ec6cee2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:16.975468 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb911c4b-bb2a-4ec3-ad2f-3e5ec6cee2d1 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:16.975751 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb911c4b-bb2a-4ec3-ad2f-3e5ec6cee2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:16.976126 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb911c4b-bb2a-4ec3-ad2f-3e5ec6cee2d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:16.977332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb911c4b-bb2a-4ec3-ad2f-3e5ec6cee2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:16.978858 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb911c4b-bb2a-4ec3-ad2f-3e5ec6cee2d1 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:16.980603 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 146/299] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:16.982723 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e435fec-49d4-4f99-863b-949a0396c2d6 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:16.983011 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e435fec-49d4-4f99-863b-949a0396c2d6 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:16.983293 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e435fec-49d4-4f99-863b-949a0396c2d6 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:16.984784 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 147/300] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:16.985705 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e435fec-49d4-4f99-863b-949a0396c2d6 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:16.989474 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:17.008726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5577a-678f-4b9e-a909-cb4d1423ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:17.010941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5577a-678f-4b9e-a909-cb4d1423ae71 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.010941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5577a-678f-4b9e-a909-cb4d1423ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.010941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5577a-678f-4b9e-a909-cb4d1423ae71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.021921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5577a-678f-4b9e-a909-cb4d1423ae71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-f0d5577a-678f-4b9e-a909-cb4d1423ae71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:17.029650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:17.030522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:17.031566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 154/301] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:17.033741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a692b2-4b97-48b9-acd0-5eb1ca4b84b5 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.033741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a692b2-4b97-48b9-acd0-5eb1ca4b84b5 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.033741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a692b2-4b97-48b9-acd0-5eb1ca4b84b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.049702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-b0a692b2-4b97-48b9-acd0-5eb1ca4b84b5 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:17.050879 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-b0a692b2-4b97-48b9-acd0-5eb1ca4b84b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:17.100589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e435fec-49d4-4f99-863b-949a0396c2d6 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:17.113848 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:17.129683 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 155/302] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:17.130392 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a692b2-4b97-48b9-acd0-5eb1ca4b84b5 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:17.139447 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d189f5c-0a54-4d6b-bc94-5a4a04f06bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:17.140112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d189f5c-0a54-4d6b-bc94-5a4a04f06bca None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.140389 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d189f5c-0a54-4d6b-bc94-5a4a04f06bca None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.140663 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d189f5c-0a54-4d6b-bc94-5a4a04f06bca None admin] PATH_INFO: `/v3/groups` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.141999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d189f5c-0a54-4d6b-bc94-5a4a04f06bca None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:17.143432 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d189f5c-0a54-4d6b-bc94-5a4a04f06bca None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:17.160149 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 148/303] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Jul 12 18:42:16 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:42:17.161325 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d189f5c-0a54-4d6b-bc94-5a4a04f06bca None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:17.252669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a692b2-4b97-48b9-acd0-5eb1ca4b84b5 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:17.253407 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:17.292835 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc736b3-eeb8-41ac-add5-fbbb6a0e375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:17.293528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc736b3-eeb8-41ac-add5-fbbb6a0e375f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.293810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc736b3-eeb8-41ac-add5-fbbb6a0e375f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.294091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc736b3-eeb8-41ac-add5-fbbb6a0e375f None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.294827 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc736b3-eeb8-41ac-add5-fbbb6a0e375f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:17.295130 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc736b3-eeb8-41ac-add5-fbbb6a0e375f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:17.296518 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc736b3-eeb8-41ac-add5-fbbb6a0e375f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:17.309135 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 156/304] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:17.312692 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d189f5c-0a54-4d6b-bc94-5a4a04f06bca None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:17.315578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc736b3-eeb8-41ac-add5-fbbb6a0e375f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:17.352805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0a38d-90e8-49e3-a532-e6b42c81063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:17.353726 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0a38d-90e8-49e3-a532-e6b42c81063f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.354012 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0a38d-90e8-49e3-a532-e6b42c81063f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.354393 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0a38d-90e8-49e3-a532-e6b42c81063f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.366557 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0a38d-90e8-49e3-a532-e6b42c81063f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-2ea0a38d-90e8-49e3-a532-e6b42c81063f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:17.375300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:17.376729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:17.377560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 149/305] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:17.382907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0a38d-90e8-49e3-a532-e6b42c81063f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:17.383359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:17.441562 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc736b3-eeb8-41ac-add5-fbbb6a0e375f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:17.482136 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a07fd-9341-48e9-b8fe-00ba6356b270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:17.483285 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a07fd-9341-48e9-b8fe-00ba6356b270 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.483560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a07fd-9341-48e9-b8fe-00ba6356b270 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.483892 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a07fd-9341-48e9-b8fe-00ba6356b270 None admin] PATH_INFO: `/v3/users/c3e24d92a87e45d683775f54f9170450` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.502207 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a07fd-9341-48e9-b8fe-00ba6356b270 None admin] RBAC: Authorizing `identity:get_user(user_id=c3e24d92a87e45d683775f54f9170450)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:17.503850 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a07fd-9341-48e9-b8fe-00ba6356b270 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:17.505727 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 157/306] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:17 2022] GET /identity/v3/users/c3e24d92a87e45d683775f54f9170450 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:17.511516 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a07fd-9341-48e9-b8fe-00ba6356b270 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:17.525839 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0a38d-90e8-49e3-a532-e6b42c81063f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:17.552494 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:17.565469 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec168c99-ace2-4d92-8514-5b320c7e49a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:17.566423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168c99-ace2-4d92-8514-5b320c7e49a6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.566844 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168c99-ace2-4d92-8514-5b320c7e49a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.567256 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec168c99-ace2-4d92-8514-5b320c7e49a6 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.568155 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec168c99-ace2-4d92-8514-5b320c7e49a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:17.568597 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec168c99-ace2-4d92-8514-5b320c7e49a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:17.570312 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec168c99-ace2-4d92-8514-5b320c7e49a6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:17.584678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 150/307] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:17.585998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec168c99-ace2-4d92-8514-5b320c7e49a6 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:17.627995 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a07fd-9341-48e9-b8fe-00ba6356b270 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:17.645653 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:17.665360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22614cac-cb84-4de1-977e-b276bccefbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:17.666121 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22614cac-cb84-4de1-977e-b276bccefbe5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.666405 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22614cac-cb84-4de1-977e-b276bccefbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.666678 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22614cac-cb84-4de1-977e-b276bccefbe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.667990 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22614cac-cb84-4de1-977e-b276bccefbe5 None admin] RBAC: Adding query filter params (role.id=b74601dfd03749c3a08d4097fc9c2868, user.id=c3e24d92a87e45d683775f54f9170450, scope.system=all) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:17.668310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22614cac-cb84-4de1-977e-b276bccefbe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:17.670118 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22614cac-cb84-4de1-977e-b276bccefbe5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:17.685319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 158/308] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Jul 12 18:42:17 2022] GET /identity/v3/role_assignments?user.id=c3e24d92a87e45d683775f54f9170450&scope.system=all&role.id=b74601dfd03749c3a08d4097fc9c2868 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:17.685319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180596d0-1b2c-4c48-9371-6e309ad6fa03 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.685319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180596d0-1b2c-4c48-9371-6e309ad6fa03 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.685319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180596d0-1b2c-4c48-9371-6e309ad6fa03 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.685319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 159/309] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:17.691677 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db7d27-cd2e-4071-90cb-e2e9449f5f44 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.691943 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db7d27-cd2e-4071-90cb-e2e9449f5f44 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.692232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db7d27-cd2e-4071-90cb-e2e9449f5f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.697639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec168c99-ace2-4d92-8514-5b320c7e49a6 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:17.710282 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-55db7d27-cd2e-4071-90cb-e2e9449f5f44 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:17.711670 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-55db7d27-cd2e-4071-90cb-e2e9449f5f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:17.743172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ee4f0-f88d-4ece-b38c-d2e43c8de03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:17.744586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ee4f0-f88d-4ece-b38c-d2e43c8de03d None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.745219 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ee4f0-f88d-4ece-b38c-d2e43c8de03d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.745696 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ee4f0-f88d-4ece-b38c-d2e43c8de03d None admin] PATH_INFO: `/v3/users/900ffed08c5f4219a9024ce8035ef81a` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.747889 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ee4f0-f88d-4ece-b38c-d2e43c8de03d None admin] RBAC: Authorizing `identity:get_user(user_id=900ffed08c5f4219a9024ce8035ef81a)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:17.751226 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ee4f0-f88d-4ece-b38c-d2e43c8de03d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:17.753939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 151/310] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:17 2022] GET /identity/v3/users/900ffed08c5f4219a9024ce8035ef81a => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:17.760761 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ee4f0-f88d-4ece-b38c-d2e43c8de03d None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:17.804094 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 160/311] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:17.834665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db7d27-cd2e-4071-90cb-e2e9449f5f44 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:17.839823 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:17.901120 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ee4f0-f88d-4ece-b38c-d2e43c8de03d None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:17.939135 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247162-f50a-4633-bdd5-2af49599398d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:17.940008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247162-f50a-4633-bdd5-2af49599398d None admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:17.940286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247162-f50a-4633-bdd5-2af49599398d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:17.940562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247162-f50a-4633-bdd5-2af49599398d None admin] PATH_INFO: `/v3/system/users/900ffed08c5f4219a9024ce8035ef81a/roles/a6f65f08e2fc407cad745e9cd18f282d` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:17.942274 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7247162-f50a-4633-bdd5-2af49599398d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=900ffed08c5f4219a9024ce8035ef81a, role_id=a6f65f08e2fc407cad745e9cd18f282d)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:17.943767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7247162-f50a-4633-bdd5-2af49599398d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:17.955207 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 152/312] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Jul 12 18:42:17 2022] PUT /identity/v3/system/users/900ffed08c5f4219a9024ce8035ef81a/roles/a6f65f08e2fc407cad745e9cd18f282d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:17.972203 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db7d27-cd2e-4071-90cb-e2e9449f5f44 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:17.987292 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:18.015284 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fc077-7157-42b3-9de5-b214c284d175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:18.016432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fc077-7157-42b3-9de5-b214c284d175 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:18.016888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fc077-7157-42b3-9de5-b214c284d175 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:18.017436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fc077-7157-42b3-9de5-b214c284d175 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:18.030504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fc077-7157-42b3-9de5-b214c284d175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-606fc077-7157-42b3-9de5-b214c284d175 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:18.039964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:18.040925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:18.041741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:18.043901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 161/313] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:18.050796 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247162-f50a-4633-bdd5-2af49599398d None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:18.166504 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7247162-f50a-4633-bdd5-2af49599398d None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:18.185557 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:18.203485 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ac7cb-f431-470c-aca0-1165bf1c61c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:18.204680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ac7cb-f431-470c-aca0-1165bf1c61c9 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:18.204961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ac7cb-f431-470c-aca0-1165bf1c61c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:18.205238 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ac7cb-f431-470c-aca0-1165bf1c61c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:18.206019 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ac7cb-f431-470c-aca0-1165bf1c61c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:18.206325 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ac7cb-f431-470c-aca0-1165bf1c61c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:18.207759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ac7cb-f431-470c-aca0-1165bf1c61c9 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:18.216350 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 153/314] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:18.222281 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fc077-7157-42b3-9de5-b214c284d175 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:18.325893 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fc077-7157-42b3-9de5-b214c284d175 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:18.360650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b2512-9e69-47ad-b8bb-ab7675db6026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:18.361600 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b2512-9e69-47ad-b8bb-ab7675db6026 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:18.361879 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b2512-9e69-47ad-b8bb-ab7675db6026 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:18.362149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b2512-9e69-47ad-b8bb-ab7675db6026 None admin] PATH_INFO: `/v3/users/67f0ce213a60409fa67cab7504aaba2f` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:18.363332 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b2512-9e69-47ad-b8bb-ab7675db6026 None admin] RBAC: Authorizing `identity:get_user(user_id=67f0ce213a60409fa67cab7504aaba2f)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:18.364754 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b2512-9e69-47ad-b8bb-ab7675db6026 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:18.366753 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 162/315] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:18 2022] GET /identity/v3/users/67f0ce213a60409fa67cab7504aaba2f => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:18.371864 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ac7cb-f431-470c-aca0-1165bf1c61c9 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:18.483823 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ac7cb-f431-470c-aca0-1165bf1c61c9 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:18.519223 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2845ac9-9be7-4b44-a0d3-71fdfb8d1e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:18.520237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2845ac9-9be7-4b44-a0d3-71fdfb8d1e27 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:18.520710 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2845ac9-9be7-4b44-a0d3-71fdfb8d1e27 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:18.521173 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2845ac9-9be7-4b44-a0d3-71fdfb8d1e27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:18.572047 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:18.592145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2845ac9-9be7-4b44-a0d3-71fdfb8d1e27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:18.593562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2845ac9-9be7-4b44-a0d3-71fdfb8d1e27 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:18.693624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 154/316] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:18.698766 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b2512-9e69-47ad-b8bb-ab7675db6026 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:18.743098 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:18.803624 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b2512-9e69-47ad-b8bb-ab7675db6026 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:18.847703 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026862c-6323-419f-b214-a530bf1746ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:18.848479 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026862c-6323-419f-b214-a530bf1746ca None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:18.848757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026862c-6323-419f-b214-a530bf1746ca None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:18.849029 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026862c-6323-419f-b214-a530bf1746ca None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:18.850237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026862c-6323-419f-b214-a530bf1746ca None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:18.851666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026862c-6323-419f-b214-a530bf1746ca None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:18.853381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 163/317] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:18 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:18.866456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2845ac9-9be7-4b44-a0d3-71fdfb8d1e27 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:18.949969 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:18.970498 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2845ac9-9be7-4b44-a0d3-71fdfb8d1e27 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:19.005320 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a9fb09-e8d0-455a-b9d8-1e6b778fd18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:19.005985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9fb09-e8d0-455a-b9d8-1e6b778fd18c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:19.006264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9fb09-e8d0-455a-b9d8-1e6b778fd18c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:19.006537 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9fb09-e8d0-455a-b9d8-1e6b778fd18c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:19.007358 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9fb09-e8d0-455a-b9d8-1e6b778fd18c None admin] RBAC: Adding query filter params (role.id=b74601dfd03749c3a08d4097fc9c2868, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c, user.id=67f0ce213a60409fa67cab7504aaba2f) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:19.007665 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9fb09-e8d0-455a-b9d8-1e6b778fd18c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:19.009089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a9fb09-e8d0-455a-b9d8-1e6b778fd18c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:19.015256 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 155/318] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:18 2022] GET /identity/v3/role_assignments?user.id=67f0ce213a60409fa67cab7504aaba2f&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=b74601dfd03749c3a08d4097fc9c2868 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:19.636058 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa9af-9c2e-4a77-8a64-3d7b10610c5d None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:19.636357 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa9af-9c2e-4a77-8a64-3d7b10610c5d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:19.636717 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fa9af-9c2e-4a77-8a64-3d7b10610c5d None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:19.638275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 164/319] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:19.643728 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f08fb0-a079-4e69-90bc-9b4572139004 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:19.644025 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f08fb0-a079-4e69-90bc-9b4572139004 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:19.644305 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f08fb0-a079-4e69-90bc-9b4572139004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:19.661150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-37f08fb0-a079-4e69-90bc-9b4572139004 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:19.662383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-37f08fb0-a079-4e69-90bc-9b4572139004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:19.736022 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 156/320] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:19.759971 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fa9af-9c2e-4a77-8a64-3d7b10610c5d None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:19.871194 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fa9af-9c2e-4a77-8a64-3d7b10610c5d None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:19.881588 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:19.911181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14636b-42a1-4ea3-845e-e1e91e920965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:19.911888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14636b-42a1-4ea3-845e-e1e91e920965 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:19.912171 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14636b-42a1-4ea3-845e-e1e91e920965 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:19.912446 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14636b-42a1-4ea3-845e-e1e91e920965 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:19.913624 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14636b-42a1-4ea3-845e-e1e91e920965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:19.915058 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14636b-42a1-4ea3-845e-e1e91e920965 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:19.916838 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 165/321] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:19.922165 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f08fb0-a079-4e69-90bc-9b4572139004 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:19.980332 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bda0d-db31-4f6f-ac48-6015b4fa893f None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:19.980656 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bda0d-db31-4f6f-ac48-6015b4fa893f None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:19.980892 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bda0d-db31-4f6f-ac48-6015b4fa893f None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:19.982302 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 166/322] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:19.987513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36c5ca-cc3e-428d-8136-6d1eafdd9406 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:19.987801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36c5ca-cc3e-428d-8136-6d1eafdd9406 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:19.988074 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36c5ca-cc3e-428d-8136-6d1eafdd9406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:20.001353 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:20.006426 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-da36c5ca-cc3e-428d-8136-6d1eafdd9406 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:20.007619 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-da36c5ca-cc3e-428d-8136-6d1eafdd9406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:20.028611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f08fb0-a079-4e69-90bc-9b4572139004 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:20.065781 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcbe30-e8ea-4b15-a755-d05c23ccdad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:20.066440 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcbe30-e8ea-4b15-a755-d05c23ccdad7 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:20.066719 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcbe30-e8ea-4b15-a755-d05c23ccdad7 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:20.067001 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcbe30-e8ea-4b15-a755-d05c23ccdad7 None admin] PATH_INFO: `/v3/groups` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:20.067690 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcbe30-e8ea-4b15-a755-d05c23ccdad7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:20.069114 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bcbe30-e8ea-4b15-a755-d05c23ccdad7 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:20.084622 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 157/323] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Jul 12 18:42:19 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:42:20.084932 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 167/324] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:20.104062 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcbe30-e8ea-4b15-a755-d05c23ccdad7 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:20.217193 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcbe30-e8ea-4b15-a755-d05c23ccdad7 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:20.253444 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea56c60-3fd4-4db3-b186-19d48e2a50a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:20.254245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56c60-3fd4-4db3-b186-19d48e2a50a1 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:20.254523 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56c60-3fd4-4db3-b186-19d48e2a50a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:20.254792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea56c60-3fd4-4db3-b186-19d48e2a50a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:20.257450 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:20.269187 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea56c60-3fd4-4db3-b186-19d48e2a50a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-9ea56c60-3fd4-4db3-b186-19d48e2a50a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:20.277152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:20.278055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:20.278850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 158/325] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:20.285507 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36c5ca-cc3e-428d-8136-6d1eafdd9406 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:20.294805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891538d-4c04-4c6b-b8cd-2cfead3f60f4 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:20.295092 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891538d-4c04-4c6b-b8cd-2cfead3f60f4 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:20.295379 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891538d-4c04-4c6b-b8cd-2cfead3f60f4 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:20.296986 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 159/326] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:42:20.303300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1869f-2ae9-4114-bd23-8883a60ec515 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:20.303581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1869f-2ae9-4114-bd23-8883a60ec515 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:20.303860 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1869f-2ae9-4114-bd23-8883a60ec515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:20.322552 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-ada1869f-2ae9-4114-bd23-8883a60ec515 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:20.323739 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-ada1869f-2ae9-4114-bd23-8883a60ec515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:20.409308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 160/327] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:20.409598 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36c5ca-cc3e-428d-8136-6d1eafdd9406 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:20.421608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:20.434525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1869f-2ae9-4114-bd23-8883a60ec515 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:20.452982 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cad94f-9cfd-47bd-82a4-73318f8d1173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:20.454221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad94f-9cfd-47bd-82a4-73318f8d1173 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:20.454502 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad94f-9cfd-47bd-82a4-73318f8d1173 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:20.454776 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad94f-9cfd-47bd-82a4-73318f8d1173 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:20.455524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cad94f-9cfd-47bd-82a4-73318f8d1173 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:20.455826 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cad94f-9cfd-47bd-82a4-73318f8d1173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:20.457195 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cad94f-9cfd-47bd-82a4-73318f8d1173 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:20.465974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 168/328] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:20.471905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cad94f-9cfd-47bd-82a4-73318f8d1173 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:20.564701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1869f-2ae9-4114-bd23-8883a60ec515 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:20.597316 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:20.608421 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cad94f-9cfd-47bd-82a4-73318f8d1173 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:20.616133 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4fe9f-d8fd-48d4-a97e-2b31205943b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:20.617414 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4fe9f-d8fd-48d4-a97e-2b31205943b5 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:20.618813 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4fe9f-d8fd-48d4-a97e-2b31205943b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:20.619302 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4fe9f-d8fd-48d4-a97e-2b31205943b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:20.631816 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4fe9f-d8fd-48d4-a97e-2b31205943b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-71b4fe9f-d8fd-48d4-a97e-2b31205943b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:20.640655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:20.642212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:20.643072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:20.646195 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 161/329] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:20.651552 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4fe9f-d8fd-48d4-a97e-2b31205943b5 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:20.652927 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609be7b9-857e-481f-993b-34f4a59b7c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:20.653836 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609be7b9-857e-481f-993b-34f4a59b7c48 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:20.654117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609be7b9-857e-481f-993b-34f4a59b7c48 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:20.654394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609be7b9-857e-481f-993b-34f4a59b7c48 None admin] PATH_INFO: `/v3/users/c3e24d92a87e45d683775f54f9170450` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:20.655617 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609be7b9-857e-481f-993b-34f4a59b7c48 None admin] RBAC: Authorizing `identity:get_user(user_id=c3e24d92a87e45d683775f54f9170450)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:20.658183 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609be7b9-857e-481f-993b-34f4a59b7c48 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:20.661082 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 169/330] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:20 2022] GET /identity/v3/users/c3e24d92a87e45d683775f54f9170450 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:20.667191 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609be7b9-857e-481f-993b-34f4a59b7c48 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:20.710644 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:20.777352 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4fe9f-d8fd-48d4-a97e-2b31205943b5 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:20.799605 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609be7b9-857e-481f-993b-34f4a59b7c48 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:20.820384 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a697a2-f68e-4fc9-9499-50020d452c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:20.821063 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a697a2-f68e-4fc9-9499-50020d452c20 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:20.821378 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a697a2-f68e-4fc9-9499-50020d452c20 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:20.821662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a697a2-f68e-4fc9-9499-50020d452c20 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:20.822404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a697a2-f68e-4fc9-9499-50020d452c20 None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:20.822863 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a697a2-f68e-4fc9-9499-50020d452c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:20.824580 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a697a2-f68e-4fc9-9499-50020d452c20 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:20.836202 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 162/331] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:20.843372 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc382d2-c4a9-4819-9531-d7daee8092b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:20.843639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a697a2-f68e-4fc9-9499-50020d452c20 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:20.844820 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc382d2-c4a9-4819-9531-d7daee8092b3 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:20.845387 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc382d2-c4a9-4819-9531-d7daee8092b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:20.845898 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc382d2-c4a9-4819-9531-d7daee8092b3 None admin] PATH_INFO: `/v3/system/users/c3e24d92a87e45d683775f54f9170450/roles/b74601dfd03749c3a08d4097fc9c2868` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:20.848128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc382d2-c4a9-4819-9531-d7daee8092b3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c3e24d92a87e45d683775f54f9170450, role_id=b74601dfd03749c3a08d4097fc9c2868)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:20.849738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc382d2-c4a9-4819-9531-d7daee8092b3 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:20.862973 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 170/332] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Jul 12 18:42:20 2022] PUT /identity/v3/system/users/c3e24d92a87e45d683775f54f9170450/roles/b74601dfd03749c3a08d4097fc9c2868 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:42:20.911807 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:20.975369 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a697a2-f68e-4fc9-9499-50020d452c20 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:21.020827 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3353ec-4bd0-4019-8f08-c69393dc2d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:21.021753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3353ec-4bd0-4019-8f08-c69393dc2d9c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:21.022090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3353ec-4bd0-4019-8f08-c69393dc2d9c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:21.022423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3353ec-4bd0-4019-8f08-c69393dc2d9c None admin] PATH_INFO: `/v3/users/900ffed08c5f4219a9024ce8035ef81a` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:21.023696 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3353ec-4bd0-4019-8f08-c69393dc2d9c None admin] RBAC: Authorizing `identity:get_user(user_id=900ffed08c5f4219a9024ce8035ef81a)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:21.025156 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3353ec-4bd0-4019-8f08-c69393dc2d9c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:21.027232 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 163/333] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:20 2022] GET /identity/v3/users/900ffed08c5f4219a9024ce8035ef81a => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:21.033645 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc382d2-c4a9-4819-9531-d7daee8092b3 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:21.150779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:21.155389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc382d2-c4a9-4819-9531-d7daee8092b3 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:21.193088 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c517-1854-4bc6-94b1-ccd3dc9f0d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:21.193784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c517-1854-4bc6-94b1-ccd3dc9f0d28 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:21.194068 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c517-1854-4bc6-94b1-ccd3dc9f0d28 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:21.194345 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c517-1854-4bc6-94b1-ccd3dc9f0d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:21.195165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c517-1854-4bc6-94b1-ccd3dc9f0d28 None admin] RBAC: Adding query filter params (role.id=a6f65f08e2fc407cad745e9cd18f282d, user.id=900ffed08c5f4219a9024ce8035ef81a, scope.system=all) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:21.195476 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c517-1854-4bc6-94b1-ccd3dc9f0d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:21.197122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c517-1854-4bc6-94b1-ccd3dc9f0d28 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:21.209901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 171/334] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Jul 12 18:42:21 2022] GET /identity/v3/role_assignments?user.id=900ffed08c5f4219a9024ce8035ef81a&scope.system=all&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:22.975344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edfeb4-1b5f-4803-856c-05bb2b7ae086 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:22.975864 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edfeb4-1b5f-4803-856c-05bb2b7ae086 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:22.975948 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edfeb4-1b5f-4803-856c-05bb2b7ae086 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:22.977690 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 164/335] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:22.983110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a1c7b-9cf8-472e-95f5-fec95f2fca1a None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:22.983546 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a1c7b-9cf8-472e-95f5-fec95f2fca1a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:22.983835 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a1c7b-9cf8-472e-95f5-fec95f2fca1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:23.006165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-a36a1c7b-9cf8-472e-95f5-fec95f2fca1a None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:23.007347 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-a36a1c7b-9cf8-472e-95f5-fec95f2fca1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:23.083879 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 172/336] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:23.126470 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edfeb4-1b5f-4803-856c-05bb2b7ae086 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:23.246175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2edfeb4-1b5f-4803-856c-05bb2b7ae086 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:23.266228 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:23.288589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7707517-ae8f-443d-a7b0-f1783cebdcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:23.289407 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7707517-ae8f-443d-a7b0-f1783cebdcdc None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:23.289691 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7707517-ae8f-443d-a7b0-f1783cebdcdc None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:23.289963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7707517-ae8f-443d-a7b0-f1783cebdcdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:23.306128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7707517-ae8f-443d-a7b0-f1783cebdcdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-c7707517-ae8f-443d-a7b0-f1783cebdcdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:23.313880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:23.314832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:23.315630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 165/337] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:23.322891 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a1c7b-9cf8-472e-95f5-fec95f2fca1a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:23.421253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:23.442291 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a1c7b-9cf8-472e-95f5-fec95f2fca1a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:23.484364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44f225-79e4-45a6-a581-95646d2afa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:23.485061 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f225-79e4-45a6-a581-95646d2afa2b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:23.485364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f225-79e4-45a6-a581-95646d2afa2b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:23.485649 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44f225-79e4-45a6-a581-95646d2afa2b None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:23.486397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44f225-79e4-45a6-a581-95646d2afa2b None admin] RBAC: Adding query filter params (name=member) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:23.486692 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44f225-79e4-45a6-a581-95646d2afa2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:23.488066 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44f225-79e4-45a6-a581-95646d2afa2b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:23.496875 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 173/338] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:23.502757 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7707517-ae8f-443d-a7b0-f1783cebdcdc None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:23.617623 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7707517-ae8f-443d-a7b0-f1783cebdcdc None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:23.652794 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21f15a-a6b7-40e4-a6a5-ed0c62c6a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:23.653468 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21f15a-a6b7-40e4-a6a5-ed0c62c6a09e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:23.653754 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21f15a-a6b7-40e4-a6a5-ed0c62c6a09e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:23.654034 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21f15a-a6b7-40e4-a6a5-ed0c62c6a09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:23.712450 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:23.745799 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21f15a-a6b7-40e4-a6a5-ed0c62c6a09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:23.747412 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21f15a-a6b7-40e4-a6a5-ed0c62c6a09e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:23.775930 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223d68b-a8fe-43e9-b1ee-c228a86b8578 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:23.776267 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223d68b-a8fe-43e9-b1ee-c228a86b8578 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:23.776497 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223d68b-a8fe-43e9-b1ee-c228a86b8578 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:23.778148 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 174/339] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:23.784583 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac1b1-055e-47ea-a47e-079a7a13def0 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:23.785441 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac1b1-055e-47ea-a47e-079a7a13def0 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:23.785730 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac1b1-055e-47ea-a47e-079a7a13def0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:23.823295 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-81aac1b1-055e-47ea-a47e-079a7a13def0 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:23.824529 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-81aac1b1-055e-47ea-a47e-079a7a13def0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:23.979426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 166/340] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:23.982647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 175/341] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:23.995946 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21f15a-a6b7-40e4-a6a5-ed0c62c6a09e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:24.030785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac1b1-055e-47ea-a47e-079a7a13def0 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:24.127685 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:24.174442 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21f15a-a6b7-40e4-a6a5-ed0c62c6a09e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:24.205492 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:24.234533 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8ef85-e152-480f-a073-33c2847de2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:24.235442 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8ef85-e152-480f-a073-33c2847de2df None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.235727 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8ef85-e152-480f-a073-33c2847de2df None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.236008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8ef85-e152-480f-a073-33c2847de2df None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.237210 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8ef85-e152-480f-a073-33c2847de2df None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:24.238832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8ef85-e152-480f-a073-33c2847de2df None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:24.240575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 167/342] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:23 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:24.244717 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac1b1-055e-47ea-a47e-079a7a13def0 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:24.246770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8ef85-e152-480f-a073-33c2847de2df None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:24.298089 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9713f2b-6ea5-41db-b0f6-e369de721cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:24.298879 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9713f2b-6ea5-41db-b0f6-e369de721cae None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.299160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9713f2b-6ea5-41db-b0f6-e369de721cae None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.299431 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9713f2b-6ea5-41db-b0f6-e369de721cae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.312930 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9713f2b-6ea5-41db-b0f6-e369de721cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-f9713f2b-6ea5-41db-b0f6-e369de721cae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:24.322487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:24.323361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:24.324580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 176/343] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:42:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:24.326429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09040c-2059-44e6-826a-1f0fddbf6555 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.326429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09040c-2059-44e6-826a-1f0fddbf6555 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.326429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09040c-2059-44e6-826a-1f0fddbf6555 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.327833 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 177/344] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:24.333198 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09040c-2059-44e6-826a-1f0fddbf6555 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:24.368150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8ef85-e152-480f-a073-33c2847de2df None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:24.408480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b691a-b1f9-4700-b2c6-d32169abdefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:24.410053 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b691a-b1f9-4700-b2c6-d32169abdefe None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.410342 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b691a-b1f9-4700-b2c6-d32169abdefe None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.410620 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b691a-b1f9-4700-b2c6-d32169abdefe None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.425200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b691a-b1f9-4700-b2c6-d32169abdefe None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:24.426693 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b691a-b1f9-4700-b2c6-d32169abdefe None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:24.428400 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 168/345] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:24 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:24.430938 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8232-2a6e-43d7-9c43-dba88c489146 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.431234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8232-2a6e-43d7-9c43-dba88c489146 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.431516 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8232-2a6e-43d7-9c43-dba88c489146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.453958 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:24.470987 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-d6ab8232-2a6e-43d7-9c43-dba88c489146 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:24.472219 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-d6ab8232-2a6e-43d7-9c43-dba88c489146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:24.559688 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 169/346] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:24.560463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09040c-2059-44e6-826a-1f0fddbf6555 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:24.560646 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab8232-2a6e-43d7-9c43-dba88c489146 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:24.624170 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bc1a8-c774-4219-bc8d-3e25b2ab317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:24.625091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bc1a8-c774-4219-bc8d-3e25b2ab317f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.625976 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bc1a8-c774-4219-bc8d-3e25b2ab317f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.626461 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2bc1a8-c774-4219-bc8d-3e25b2ab317f None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.627627 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bc1a8-c774-4219-bc8d-3e25b2ab317f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:24.628201 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bc1a8-c774-4219-bc8d-3e25b2ab317f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:24.630228 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2bc1a8-c774-4219-bc8d-3e25b2ab317f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:24.636035 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:24.640601 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 178/347] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:24.642388 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bc1a8-c774-4219-bc8d-3e25b2ab317f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:24.679699 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab8232-2a6e-43d7-9c43-dba88c489146 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:24.721082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce1338-3f93-4db8-bc72-7bf5b6f031af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:24.722258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce1338-3f93-4db8-bc72-7bf5b6f031af None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.723198 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce1338-3f93-4db8-bc72-7bf5b6f031af None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.723640 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce1338-3f93-4db8-bc72-7bf5b6f031af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.724620 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce1338-3f93-4db8-bc72-7bf5b6f031af None admin] RBAC: Adding query filter params (group.id=2fec6caeef9d49d991c81cd5959380c5, role.id=a6f65f08e2fc407cad745e9cd18f282d, scope.project.id=e7415ae7a8bf412685572674e06f9d13) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:24.725062 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce1338-3f93-4db8-bc72-7bf5b6f031af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:24.727669 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce1338-3f93-4db8-bc72-7bf5b6f031af None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:24.737762 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:24.743506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 170/348] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Jul 12 18:42:24 2022] GET /identity/v3/role_assignments?group.id=2fec6caeef9d49d991c81cd5959380c5&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:24.745971 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce1338-3f93-4db8-bc72-7bf5b6f031af None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:24.790918 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2bc1a8-c774-4219-bc8d-3e25b2ab317f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:24.840879 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ace7c-a0c6-4d73-aa5a-6974b3db2ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:24.841661 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ace7c-a0c6-4d73-aa5a-6974b3db2ff4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.841948 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ace7c-a0c6-4d73-aa5a-6974b3db2ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.842225 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ace7c-a0c6-4d73-aa5a-6974b3db2ff4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.854072 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ace7c-a0c6-4d73-aa5a-6974b3db2ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-712ace7c-a0c6-4d73-aa5a-6974b3db2ff4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:24.864630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:24.865682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:24.866597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 179/349] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:24.867801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a0ee1-85aa-4a40-b96a-1c3d94f96e92 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.867920 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a0ee1-85aa-4a40-b96a-1c3d94f96e92 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.870725 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a0ee1-85aa-4a40-b96a-1c3d94f96e92 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.870725 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 180/350] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:24.870939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855bcdf-709c-4145-83d5-d788fb61e586 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.871225 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855bcdf-709c-4145-83d5-d788fb61e586 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.871502 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855bcdf-709c-4145-83d5-d788fb61e586 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.878033 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 181/351] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:24.879005 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855bcdf-709c-4145-83d5-d788fb61e586 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:24.907405 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce1338-3f93-4db8-bc72-7bf5b6f031af None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:24.952015 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6563c3-fb0a-438d-93a7-77739215ff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:24.952737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6563c3-fb0a-438d-93a7-77739215ff85 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:24.953022 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6563c3-fb0a-438d-93a7-77739215ff85 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:24.953339 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6563c3-fb0a-438d-93a7-77739215ff85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:24.961873 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:25.013518 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855bcdf-709c-4145-83d5-d788fb61e586 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:25.050963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:25.053626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6563c3-fb0a-438d-93a7-77739215ff85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:25.055269 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6563c3-fb0a-438d-93a7-77739215ff85 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:25.057841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb8528-9d6b-4e7b-8b1d-844f8224b573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:25.059349 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb8528-9d6b-4e7b-8b1d-844f8224b573 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:25.059793 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb8528-9d6b-4e7b-8b1d-844f8224b573 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:25.060209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb8528-9d6b-4e7b-8b1d-844f8224b573 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:25.061113 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb8528-9d6b-4e7b-8b1d-844f8224b573 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:25.061596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb8528-9d6b-4e7b-8b1d-844f8224b573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:25.063710 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb8528-9d6b-4e7b-8b1d-844f8224b573 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:25.073331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 182/352] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:25.075602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f00a7e-63af-41fa-a8dc-269006ad302b None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:25.075712 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f00a7e-63af-41fa-a8dc-269006ad302b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:25.076112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f00a7e-63af-41fa-a8dc-269006ad302b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:25.095896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-c7f00a7e-63af-41fa-a8dc-269006ad302b None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:25.097018 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-c7f00a7e-63af-41fa-a8dc-269006ad302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:25.181747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 183/353] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:25.183187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e8e0b-8f58-4df2-9a7d-2cd8c7c63c6d None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:25.183573 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e8e0b-8f58-4df2-9a7d-2cd8c7c63c6d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:25.183852 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e8e0b-8f58-4df2-9a7d-2cd8c7c63c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:25.186835 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 171/354] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:25.187757 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6563c3-fb0a-438d-93a7-77739215ff85 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:25.215602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-9b4e8e0b-8f58-4df2-9a7d-2cd8c7c63c6d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:25.216787 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-9b4e8e0b-8f58-4df2-9a7d-2cd8c7c63c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:25.283382 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:25.318797 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 184/355] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:25.319729 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e8e0b-8f58-4df2-9a7d-2cd8c7c63c6d None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:25.367796 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:25.371762 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6563c3-fb0a-438d-93a7-77739215ff85 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:25.418016 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297162f-5749-4415-9b81-f7ec73b1e240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:25.418949 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297162f-5749-4415-9b81-f7ec73b1e240 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:25.419258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297162f-5749-4415-9b81-f7ec73b1e240 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:25.419677 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297162f-5749-4415-9b81-f7ec73b1e240 None admin] PATH_INFO: `/v3/users/c3e24d92a87e45d683775f54f9170450` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:25.421491 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297162f-5749-4415-9b81-f7ec73b1e240 None admin] RBAC: Authorizing `identity:get_user(user_id=c3e24d92a87e45d683775f54f9170450)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:25.424491 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297162f-5749-4415-9b81-f7ec73b1e240 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:25.426800 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 172/356] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Jul 12 18:42:25 2022] GET /identity/v3/users/c3e24d92a87e45d683775f54f9170450 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:25.427584 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297162f-5749-4415-9b81-f7ec73b1e240 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:25.481425 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e8e0b-8f58-4df2-9a7d-2cd8c7c63c6d None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:25.524002 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4326758-052d-4730-9a52-7ecae4b6c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:25.524002 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4326758-052d-4730-9a52-7ecae4b6c7ab None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:25.524002 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4326758-052d-4730-9a52-7ecae4b6c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:25.524002 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4326758-052d-4730-9a52-7ecae4b6c7ab None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:25.524927 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4326758-052d-4730-9a52-7ecae4b6c7ab None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:25.526664 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4326758-052d-4730-9a52-7ecae4b6c7ab None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:25.528573 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 185/357] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:25 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:25.534119 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4326758-052d-4730-9a52-7ecae4b6c7ab None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:25.568346 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297162f-5749-4415-9b81-f7ec73b1e240 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:25.616207 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:25.618506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12212083-7fa1-4b72-a9be-9fcb335c2494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:25.619547 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12212083-7fa1-4b72-a9be-9fcb335c2494 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:25.619947 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12212083-7fa1-4b72-a9be-9fcb335c2494 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:25.620235 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12212083-7fa1-4b72-a9be-9fcb335c2494 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:25.635149 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12212083-7fa1-4b72-a9be-9fcb335c2494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-12212083-7fa1-4b72-a9be-9fcb335c2494 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:25.644817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:25.646032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:25.646838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:25.648083 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 173/358] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:25.648738 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9f631-3541-489d-8ce7-6a542c485736 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:25.649026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9f631-3541-489d-8ce7-6a542c485736 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:25.649528 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9f631-3541-489d-8ce7-6a542c485736 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:25.651850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 174/359] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:25.651850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9f631-3541-489d-8ce7-6a542c485736 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:25.683713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4326758-052d-4730-9a52-7ecae4b6c7ab None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:25.693462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:25.737580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d3763-3658-4dd9-b1ad-20ac9ec91b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:25.738592 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3763-3658-4dd9-b1ad-20ac9ec91b9c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:25.738814 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3763-3658-4dd9-b1ad-20ac9ec91b9c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:25.739165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d3763-3658-4dd9-b1ad-20ac9ec91b9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:25.753590 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d3763-3658-4dd9-b1ad-20ac9ec91b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-e18d3763-3658-4dd9-b1ad-20ac9ec91b9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:25.762991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:25.763910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:25.764714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 186/360] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:42:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:25.765510 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d3763-3658-4dd9-b1ad-20ac9ec91b9c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:25.812160 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9f631-3541-489d-8ce7-6a542c485736 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:25.859291 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee81316-914f-40a4-9d89-2a0c40fa3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:25.861947 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee81316-914f-40a4-9d89-2a0c40fa3006 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:25.862234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee81316-914f-40a4-9d89-2a0c40fa3006 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:25.862512 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee81316-914f-40a4-9d89-2a0c40fa3006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:25.863350 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee81316-914f-40a4-9d89-2a0c40fa3006 None admin] RBAC: Adding query filter params (role.id=b74601dfd03749c3a08d4097fc9c2868, user.id=c3e24d92a87e45d683775f54f9170450, scope.system=all) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:25.863662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee81316-914f-40a4-9d89-2a0c40fa3006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:25.865108 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee81316-914f-40a4-9d89-2a0c40fa3006 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:25.889451 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 175/361] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Jul 12 18:42:25 2022] GET /identity/v3/role_assignments?user.id=c3e24d92a87e45d683775f54f9170450&scope.system=all&role.id=b74601dfd03749c3a08d4097fc9c2868 => generated 510 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:25.890264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee81316-914f-40a4-9d89-2a0c40fa3006 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:25.924614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d3763-3658-4dd9-b1ad-20ac9ec91b9c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:25.941533 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:25.988452 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d0a7a-5fbc-4edb-9b4b-b03d5d348b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:25.989391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d0a7a-5fbc-4edb-9b4b-b03d5d348b34 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:25.989676 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d0a7a-5fbc-4edb-9b4b-b03d5d348b34 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:25.989954 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d0a7a-5fbc-4edb-9b4b-b03d5d348b34 None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:25.991231 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d0a7a-5fbc-4edb-9b4b-b03d5d348b34 None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:25.992719 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d0a7a-5fbc-4edb-9b4b-b03d5d348b34 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:25.994650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 187/362] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:25 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:26.000766 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b1658-afca-4585-800a-75b07e262924 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:26.001044 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b1658-afca-4585-800a-75b07e262924 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:26.001398 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b1658-afca-4585-800a-75b07e262924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:26.024743 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-a69b1658-afca-4585-800a-75b07e262924 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:26.025991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-a69b1658-afca-4585-800a-75b07e262924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:26.027337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:26.058350 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee81316-914f-40a4-9d89-2a0c40fa3006 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:26.113938 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50c10d-ee0a-4169-8770-a4c2ee65b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:26.114837 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50c10d-ee0a-4169-8770-a4c2ee65b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:26.115116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50c10d-ee0a-4169-8770-a4c2ee65b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:26.115401 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50c10d-ee0a-4169-8770-a4c2ee65b0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:26.116444 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50c10d-ee0a-4169-8770-a4c2ee65b0f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:26.116981 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50c10d-ee0a-4169-8770-a4c2ee65b0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:26.121490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50c10d-ee0a-4169-8770-a4c2ee65b0f2 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:26.124340 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 188/363] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:26.127069 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b1658-afca-4585-800a-75b07e262924 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:26.133694 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 176/364] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:26.134355 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50c10d-ee0a-4169-8770-a4c2ee65b0f2 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:26.283583 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50c10d-ee0a-4169-8770-a4c2ee65b0f2 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:26.298873 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b1658-afca-4585-800a-75b07e262924 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:26.313599 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:26.337494 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6c129-9a39-453d-8bd5-6be087fcd8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:26.338535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c129-9a39-453d-8bd5-6be087fcd8c0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:26.338823 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c129-9a39-453d-8bd5-6be087fcd8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:26.339105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6c129-9a39-453d-8bd5-6be087fcd8c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:26.340782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6c129-9a39-453d-8bd5-6be087fcd8c0 None admin] RBAC: Adding query filter params (group.id=2fec6caeef9d49d991c81cd5959380c5, role.id=3ca3c240900e4ca5865d244abf112295, scope.project.id=e7415ae7a8bf412685572674e06f9d13) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:26.340782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6c129-9a39-453d-8bd5-6be087fcd8c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:26.343091 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6c129-9a39-453d-8bd5-6be087fcd8c0 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:26.354472 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 177/365] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Jul 12 18:42:26 2022] GET /identity/v3/role_assignments?group.id=2fec6caeef9d49d991c81cd5959380c5&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=3ca3c240900e4ca5865d244abf112295 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:26.355277 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4cf5d-2431-4dd1-a531-b60c6ee85f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:26.355402 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6c129-9a39-453d-8bd5-6be087fcd8c0 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:26.355951 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4cf5d-2431-4dd1-a531-b60c6ee85f58 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:26.356234 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4cf5d-2431-4dd1-a531-b60c6ee85f58 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:26.356579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4cf5d-2431-4dd1-a531-b60c6ee85f58 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:26.357394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4cf5d-2431-4dd1-a531-b60c6ee85f58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:26.357854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4cf5d-2431-4dd1-a531-b60c6ee85f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:26.359331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4cf5d-2431-4dd1-a531-b60c6ee85f58 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:26.368504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 189/366] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:26.369530 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4cf5d-2431-4dd1-a531-b60c6ee85f58 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:26.378283 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:26.483719 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6c129-9a39-453d-8bd5-6be087fcd8c0 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:26.490673 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4cf5d-2431-4dd1-a531-b60c6ee85f58 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:26.524554 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194416ab-6220-44d4-97e4-ba072d37ed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:26.525327 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194416ab-6220-44d4-97e4-ba072d37ed18 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:26.525613 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194416ab-6220-44d4-97e4-ba072d37ed18 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:26.525888 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194416ab-6220-44d4-97e4-ba072d37ed18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:26.535514 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea2fb-fb73-4360-8dbb-b47d4f07148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:26.536657 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea2fb-fb73-4360-8dbb-b47d4f07148f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:26.537110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea2fb-fb73-4360-8dbb-b47d4f07148f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:26.538159 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ea2fb-fb73-4360-8dbb-b47d4f07148f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:26.554608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ea2fb-fb73-4360-8dbb-b47d4f07148f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-392ea2fb-fb73-4360-8dbb-b47d4f07148f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:26.565128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:26.566112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:26.566910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:26.569245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 190/367] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:26.570282 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea2fb-fb73-4360-8dbb-b47d4f07148f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:26.619486 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:26.641670 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194416ab-6220-44d4-97e4-ba072d37ed18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:26.643390 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194416ab-6220-44d4-97e4-ba072d37ed18 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:26.683828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:26.712974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ea2fb-fb73-4360-8dbb-b47d4f07148f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:26.758426 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d2c4-adc7-481a-abfa-cfcbf2d5e3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:26.758998 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d2c4-adc7-481a-abfa-cfcbf2d5e3c1 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:26.759276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d2c4-adc7-481a-abfa-cfcbf2d5e3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:26.759553 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d2c4-adc7-481a-abfa-cfcbf2d5e3c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:26.760461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 178/368] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:26.761640 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194416ab-6220-44d4-97e4-ba072d37ed18 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:26.841501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607d2c4-adc7-481a-abfa-cfcbf2d5e3c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:26.844782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607d2c4-adc7-481a-abfa-cfcbf2d5e3c1 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:26.898514 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:26.903588 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194416ab-6220-44d4-97e4-ba072d37ed18 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:26.945677 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:26.948615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92842225-d1fa-4d4b-80d9-c480a77f1b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:26.949482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92842225-d1fa-4d4b-80d9-c480a77f1b3d None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:26.949764 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92842225-d1fa-4d4b-80d9-c480a77f1b3d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:26.950039 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92842225-d1fa-4d4b-80d9-c480a77f1b3d None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:26.951745 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92842225-d1fa-4d4b-80d9-c480a77f1b3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:26.952055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92842225-d1fa-4d4b-80d9-c480a77f1b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:26.953500 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92842225-d1fa-4d4b-80d9-c480a77f1b3d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:26.964382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 179/369] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:26.966109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92842225-d1fa-4d4b-80d9-c480a77f1b3d None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:27.001792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 191/370] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:27.002489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d2c4-adc7-481a-abfa-cfcbf2d5e3c1 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:27.115962 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92842225-d1fa-4d4b-80d9-c480a77f1b3d None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:27.152849 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d2c4-adc7-481a-abfa-cfcbf2d5e3c1 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:27.169709 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273886ae-cacf-4e55-b0f8-e19a83955b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:27.171245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273886ae-cacf-4e55-b0f8-e19a83955b74 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:27.171683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273886ae-cacf-4e55-b0f8-e19a83955b74 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:27.172945 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273886ae-cacf-4e55-b0f8-e19a83955b74 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:27.174775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273886ae-cacf-4e55-b0f8-e19a83955b74 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:27.177417 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273886ae-cacf-4e55-b0f8-e19a83955b74 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:27.180362 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 180/371] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:26 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:27.181602 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273886ae-cacf-4e55-b0f8-e19a83955b74 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:27.193653 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:27.206656 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47951a3d-6354-4eee-abe8-0d96a57681db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:27.207608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47951a3d-6354-4eee-abe8-0d96a57681db None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:27.208044 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47951a3d-6354-4eee-abe8-0d96a57681db None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:27.208464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47951a3d-6354-4eee-abe8-0d96a57681db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:27.238114 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:27.289747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47951a3d-6354-4eee-abe8-0d96a57681db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:27.291543 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47951a3d-6354-4eee-abe8-0d96a57681db None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:27.310956 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273886ae-cacf-4e55-b0f8-e19a83955b74 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:27.352491 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6464e4-b0a1-4737-9316-e3091193663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:27.353403 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6464e4-b0a1-4737-9316-e3091193663a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:27.353691 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6464e4-b0a1-4737-9316-e3091193663a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:27.353965 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6464e4-b0a1-4737-9316-e3091193663a None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:27.355154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6464e4-b0a1-4737-9316-e3091193663a None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:27.356605 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6464e4-b0a1-4737-9316-e3091193663a None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:27.358339 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 181/372] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:27 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:27.359090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6464e4-b0a1-4737-9316-e3091193663a None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:27.414499 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 192/373] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:27.416591 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aa210-e413-4b8c-8661-9bfedc54598d None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:27.417139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aa210-e413-4b8c-8661-9bfedc54598d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:27.417587 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30aa210-e413-4b8c-8661-9bfedc54598d None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:27.419584 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 193/374] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:27.420832 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aa210-e413-4b8c-8661-9bfedc54598d None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:27.460982 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:27.490611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6464e4-b0a1-4737-9316-e3091193663a None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:27.504505 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:27.538431 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24f595-5e3e-4bec-841f-40bbb398af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:27.540715 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24f595-5e3e-4bec-841f-40bbb398af41 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:27.540715 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24f595-5e3e-4bec-841f-40bbb398af41 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:27.540715 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24f595-5e3e-4bec-841f-40bbb398af41 None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:27.542101 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24f595-5e3e-4bec-841f-40bbb398af41 None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:27.543554 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24f595-5e3e-4bec-841f-40bbb398af41 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:27.545202 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 182/375] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:27 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:27.546124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24f595-5e3e-4bec-841f-40bbb398af41 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:27.554847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30aa210-e413-4b8c-8661-9bfedc54598d None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:27.601369 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b054e88-716b-4173-8561-1bf6fba93b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:27.602866 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b054e88-716b-4173-8561-1bf6fba93b90 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:27.604148 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b054e88-716b-4173-8561-1bf6fba93b90 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:27.604148 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b054e88-716b-4173-8561-1bf6fba93b90 None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:27.605853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b054e88-716b-4173-8561-1bf6fba93b90 None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:27.607780 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b054e88-716b-4173-8561-1bf6fba93b90 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:27.613112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 194/376] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:27 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:27.613112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08b2c5-359f-4c77-92de-e822ae39ac75 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:27.613112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08b2c5-359f-4c77-92de-e822ae39ac75 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:27.613112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08b2c5-359f-4c77-92de-e822ae39ac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:27.630812 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-ae08b2c5-359f-4c77-92de-e822ae39ac75 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:27.632005 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-ae08b2c5-359f-4c77-92de-e822ae39ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:27.675732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24f595-5e3e-4bec-841f-40bbb398af41 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:27.715315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1133ef4-5973-4581-9efe-563119015009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:27.716183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1133ef4-5973-4581-9efe-563119015009 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:27.716469 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1133ef4-5973-4581-9efe-563119015009 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:27.716742 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1133ef4-5973-4581-9efe-563119015009 None admin] PATH_INFO: `/v3/projects/50ac8b5806ca4cab991abf52d2b9928f` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:27.717962 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1133ef4-5973-4581-9efe-563119015009 None admin] RBAC: Authorizing `identity:get_project(project_id=50ac8b5806ca4cab991abf52d2b9928f)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:27.719445 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1133ef4-5973-4581-9efe-563119015009 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:27.721180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 183/377] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:27 2022] GET /identity/v3/projects/50ac8b5806ca4cab991abf52d2b9928f => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:27.721957 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1133ef4-5973-4581-9efe-563119015009 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:27.738376 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 195/378] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:27.739548 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08b2c5-359f-4c77-92de-e822ae39ac75 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:27.779168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:27.779774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:27.843339 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1133ef4-5973-4581-9efe-563119015009 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:27.870945 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08b2c5-359f-4c77-92de-e822ae39ac75 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:27.886989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832e84c-ea40-450e-9f78-ffb6a0426c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:27.888086 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832e84c-ea40-450e-9f78-ffb6a0426c60 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:27.888086 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832e84c-ea40-450e-9f78-ffb6a0426c60 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:27.888247 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e832e84c-ea40-450e-9f78-ffb6a0426c60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:27.889436 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832e84c-ea40-450e-9f78-ffb6a0426c60 None admin] RBAC: Adding query filter params (group.id=2fec6caeef9d49d991c81cd5959380c5, role.id=a6f65f08e2fc407cad745e9cd18f282d, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:27.890570 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832e84c-ea40-450e-9f78-ffb6a0426c60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:27.892597 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e832e84c-ea40-450e-9f78-ffb6a0426c60 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:27.901564 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 184/379] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Jul 12 18:42:27 2022] GET /identity/v3/role_assignments?group.id=2fec6caeef9d49d991c81cd5959380c5&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:27.902395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832e84c-ea40-450e-9f78-ffb6a0426c60 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:27.922950 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4d798-a307-4ada-9025-2e399cb71c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:27.923678 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d798-a307-4ada-9025-2e399cb71c56 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:27.924021 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d798-a307-4ada-9025-2e399cb71c56 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:27.924307 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4d798-a307-4ada-9025-2e399cb71c56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:27.926957 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4d798-a307-4ada-9025-2e399cb71c56 None admin] RBAC: Adding query filter params (group.id=2fec6caeef9d49d991c81cd5959380c5, role.id=3ca3c240900e4ca5865d244abf112295, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:27.927220 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4d798-a307-4ada-9025-2e399cb71c56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:27.929186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4d798-a307-4ada-9025-2e399cb71c56 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:27.938327 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 196/380] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Jul 12 18:42:27 2022] GET /identity/v3/role_assignments?group.id=2fec6caeef9d49d991c81cd5959380c5&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=3ca3c240900e4ca5865d244abf112295 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:27.939214 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4d798-a307-4ada-9025-2e399cb71c56 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:28.065461 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:28.076381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4d798-a307-4ada-9025-2e399cb71c56 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:28.118251 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e832e84c-ea40-450e-9f78-ffb6a0426c60 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:28.121539 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd36a4-932b-46bb-8409-6d56cedd9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:28.123257 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd36a4-932b-46bb-8409-6d56cedd9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:28.123548 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd36a4-932b-46bb-8409-6d56cedd9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:28.123828 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd36a4-932b-46bb-8409-6d56cedd9ee9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:28.134113 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:28.140157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd36a4-932b-46bb-8409-6d56cedd9ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-f9bd36a4-932b-46bb-8409-6d56cedd9ee9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:28.150132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:28.151090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:28.151888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 197/381] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:28.158589 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd36a4-932b-46bb-8409-6d56cedd9ee9 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:28.173863 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa6303-2938-4414-a941-89e01f1d459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:28.175107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6303-2938-4414-a941-89e01f1d459b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:28.175643 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6303-2938-4414-a941-89e01f1d459b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:28.176159 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6303-2938-4414-a941-89e01f1d459b None admin] PATH_INFO: `/v3/groups/1fdfa5a32f7f4eb697baba160be92c78` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:28.182210 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa6303-2938-4414-a941-89e01f1d459b None admin] RBAC: Authorizing `identity:get_group(group_id=1fdfa5a32f7f4eb697baba160be92c78)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:28.184013 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa6303-2938-4414-a941-89e01f1d459b None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:28.186689 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 185/382] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:27 2022] GET /identity/v3/groups/1fdfa5a32f7f4eb697baba160be92c78 => generated 229 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:28.192482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa6303-2938-4414-a941-89e01f1d459b None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:28.310257 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd36a4-932b-46bb-8409-6d56cedd9ee9 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:28.344980 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa6303-2938-4414-a941-89e01f1d459b None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:28.355743 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabea01-e0e5-4a5e-846c-84364743973b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:28.356500 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabea01-e0e5-4a5e-846c-84364743973b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:28.357111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabea01-e0e5-4a5e-846c-84364743973b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:28.357111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabea01-e0e5-4a5e-846c-84364743973b None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:28.358036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabea01-e0e5-4a5e-846c-84364743973b None admin] RBAC: Adding query filter params (name=member) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:28.358446 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabea01-e0e5-4a5e-846c-84364743973b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:28.359970 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabea01-e0e5-4a5e-846c-84364743973b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:28.369909 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 198/383] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:28.376045 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabea01-e0e5-4a5e-846c-84364743973b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:28.396259 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:28.396460 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9172e2-42c1-4f29-8b73-e02ae97cab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:28.396924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9172e2-42c1-4f29-8b73-e02ae97cab9b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:28.397319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9172e2-42c1-4f29-8b73-e02ae97cab9b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:28.397691 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9172e2-42c1-4f29-8b73-e02ae97cab9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:28.399226 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9172e2-42c1-4f29-8b73-e02ae97cab9b None admin] RBAC: Adding query filter params (group.id=1fdfa5a32f7f4eb697baba160be92c78, role.id=948b82ff28c547e78755c196cddfdd0e, scope.project.id=50ac8b5806ca4cab991abf52d2b9928f) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:28.399226 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9172e2-42c1-4f29-8b73-e02ae97cab9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:28.400080 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9172e2-42c1-4f29-8b73-e02ae97cab9b None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:28.409466 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 186/384] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Jul 12 18:42:28 2022] GET /identity/v3/role_assignments?group.id=1fdfa5a32f7f4eb697baba160be92c78&scope.project.id=50ac8b5806ca4cab991abf52d2b9928f&role.id=948b82ff28c547e78755c196cddfdd0e => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:28.505563 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabea01-e0e5-4a5e-846c-84364743973b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:28.544227 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeebe1-c3cd-4bf0-8701-c7c2bb4cef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:28.545101 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeebe1-c3cd-4bf0-8701-c7c2bb4cef50 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:28.545403 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeebe1-c3cd-4bf0-8701-c7c2bb4cef50 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:28.545682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeebe1-c3cd-4bf0-8701-c7c2bb4cef50 None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:28.546974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deeebe1-c3cd-4bf0-8701-c7c2bb4cef50 None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:28.548422 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deeebe1-c3cd-4bf0-8701-c7c2bb4cef50 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:28.550439 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 199/385] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:28 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:28.556099 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9172e2-42c1-4f29-8b73-e02ae97cab9b None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:28.601056 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:28.669742 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9172e2-42c1-4f29-8b73-e02ae97cab9b None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:28.706535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c8317-89c5-4b57-9f0e-6a26d9bb6d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:28.707402 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c8317-89c5-4b57-9f0e-6a26d9bb6d20 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:28.707680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c8317-89c5-4b57-9f0e-6a26d9bb6d20 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:28.707955 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c8317-89c5-4b57-9f0e-6a26d9bb6d20 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:28.709151 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c8317-89c5-4b57-9f0e-6a26d9bb6d20 None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:28.710620 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c8317-89c5-4b57-9f0e-6a26d9bb6d20 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:28.712333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 187/386] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:28 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:28.718115 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeebe1-c3cd-4bf0-8701-c7c2bb4cef50 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:28.808916 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:28.832781 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeebe1-c3cd-4bf0-8701-c7c2bb4cef50 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:28.868779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86322e-9741-47ea-8453-de5c16243753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:28.869682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86322e-9741-47ea-8453-de5c16243753 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:28.869960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86322e-9741-47ea-8453-de5c16243753 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:28.870232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86322e-9741-47ea-8453-de5c16243753 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13/groups/2fec6caeef9d49d991c81cd5959380c5/roles/a6f65f08e2fc407cad745e9cd18f282d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:28.872158 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86322e-9741-47ea-8453-de5c16243753 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7415ae7a8bf412685572674e06f9d13, group_id=2fec6caeef9d49d991c81cd5959380c5, role_id=a6f65f08e2fc407cad745e9cd18f282d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:28.873596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86322e-9741-47ea-8453-de5c16243753 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:28.892977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 200/387] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Jul 12 18:42:28 2022] PUT /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13/groups/2fec6caeef9d49d991c81cd5959380c5/roles/a6f65f08e2fc407cad745e9cd18f282d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:28.992580 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b617-a047-406b-a3fe-3007c23c6855 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:28.992945 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b617-a047-406b-a3fe-3007c23c6855 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:28.993227 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b617-a047-406b-a3fe-3007c23c6855 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:28.994752 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 188/388] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:29.000696 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1b560-e135-4817-befe-21640486e7c2 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:29.001030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1b560-e135-4817-befe-21640486e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:29.001329 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1b560-e135-4817-befe-21640486e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:29.023365 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-bff1b560-e135-4817-befe-21640486e7c2 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:29.024569 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-bff1b560-e135-4817-befe-21640486e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:29.107165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 201/389] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:29.148021 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282b617-a047-406b-a3fe-3007c23c6855 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:29.262877 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282b617-a047-406b-a3fe-3007c23c6855 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:29.271236 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:29.300069 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c521f-3edb-41d5-8b57-c6cc81fdae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:29.300878 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c521f-3edb-41d5-8b57-c6cc81fdae7a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:29.301210 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c521f-3edb-41d5-8b57-c6cc81fdae7a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:29.301511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c521f-3edb-41d5-8b57-c6cc81fdae7a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:29.313133 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c521f-3edb-41d5-8b57-c6cc81fdae7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-346c521f-3edb-41d5-8b57-c6cc81fdae7a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:29.321475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:29.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:29.323234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 189/390] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:42:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:29.333476 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1b560-e135-4817-befe-21640486e7c2 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:29.405708 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:29.441623 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff1b560-e135-4817-befe-21640486e7c2 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:29.476592 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7eb79-53d2-40a4-ada2-665a5b9edb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:29.477260 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7eb79-53d2-40a4-ada2-665a5b9edb5a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:29.477562 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7eb79-53d2-40a4-ada2-665a5b9edb5a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:29.477887 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7eb79-53d2-40a4-ada2-665a5b9edb5a None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:29.478619 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7eb79-53d2-40a4-ada2-665a5b9edb5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:29.478922 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7eb79-53d2-40a4-ada2-665a5b9edb5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:29.480274 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7eb79-53d2-40a4-ada2-665a5b9edb5a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:29.489723 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 202/391] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:29.497726 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c521f-3edb-41d5-8b57-c6cc81fdae7a None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:29.624458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c521f-3edb-41d5-8b57-c6cc81fdae7a None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:29.668646 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddada696-8ded-4f7f-9c37-62d3223e28da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:29.669454 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada696-8ded-4f7f-9c37-62d3223e28da None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:29.669729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada696-8ded-4f7f-9c37-62d3223e28da None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:29.670007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddada696-8ded-4f7f-9c37-62d3223e28da None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:29.673963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddada696-8ded-4f7f-9c37-62d3223e28da None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:29.675430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddada696-8ded-4f7f-9c37-62d3223e28da None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:29.677561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 190/392] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:29 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:29.682977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7eb79-53d2-40a4-ada2-665a5b9edb5a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:29.802406 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7eb79-53d2-40a4-ada2-665a5b9edb5a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:29.837828 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2903b-41cd-4c39-b1fe-29ebc0c70abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:29.838685 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2903b-41cd-4c39-b1fe-29ebc0c70abf None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:29.838964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2903b-41cd-4c39-b1fe-29ebc0c70abf None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:29.839235 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2903b-41cd-4c39-b1fe-29ebc0c70abf None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:29.840404 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2903b-41cd-4c39-b1fe-29ebc0c70abf None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:29.841868 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2903b-41cd-4c39-b1fe-29ebc0c70abf None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:29.843558 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 203/393] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:29 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:29.849345 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddada696-8ded-4f7f-9c37-62d3223e28da None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:29.915135 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:29.996704 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddada696-8ded-4f7f-9c37-62d3223e28da None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:30.031665 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8875bb-4c71-40bd-9b2c-0ac9312ab8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:30.032717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8875bb-4c71-40bd-9b2c-0ac9312ab8a6 None admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:30.033010 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8875bb-4c71-40bd-9b2c-0ac9312ab8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:30.033303 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8875bb-4c71-40bd-9b2c-0ac9312ab8a6 None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13/groups/2fec6caeef9d49d991c81cd5959380c5/roles/3ca3c240900e4ca5865d244abf112295` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:30.035542 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8875bb-4c71-40bd-9b2c-0ac9312ab8a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7415ae7a8bf412685572674e06f9d13, group_id=2fec6caeef9d49d991c81cd5959380c5, role_id=3ca3c240900e4ca5865d244abf112295)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:30.036985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8875bb-4c71-40bd-9b2c-0ac9312ab8a6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:30.059862 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 191/394] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Jul 12 18:42:29 2022] PUT /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13/groups/2fec6caeef9d49d991c81cd5959380c5/roles/3ca3c240900e4ca5865d244abf112295 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:30.864106 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d891f-b9d9-4e18-b780-d94b327cac20 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:30.864632 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d891f-b9d9-4e18-b780-d94b327cac20 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:30.864706 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d891f-b9d9-4e18-b780-d94b327cac20 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:30.866359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 204/395] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:30.883190 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55b36-64e3-49c2-90d7-862f72a7a180 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:30.883645 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55b36-64e3-49c2-90d7-862f72a7a180 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:30.883814 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d55b36-64e3-49c2-90d7-862f72a7a180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:30.904614 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-c3d55b36-64e3-49c2-90d7-862f72a7a180 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:30.906103 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-c3d55b36-64e3-49c2-90d7-862f72a7a180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:31.002902 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31422a-4d64-4b0d-9cc0-06101ba6dbab None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.003252 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31422a-4d64-4b0d-9cc0-06101ba6dbab None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.003494 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31422a-4d64-4b0d-9cc0-06101ba6dbab None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.003792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 192/396] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:31.004868 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 205/397] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:31.010048 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4ec26-798d-4170-81a3-cf64bd08958e None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.010337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4ec26-798d-4170-81a3-cf64bd08958e None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.010621 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4ec26-798d-4170-81a3-cf64bd08958e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.029393 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31422a-4d64-4b0d-9cc0-06101ba6dbab None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:31.033151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:31.034735 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-97a4ec26-798d-4170-81a3-cf64bd08958e None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:31.035909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-97a4ec26-798d-4170-81a3-cf64bd08958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:31.058342 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:31.112348 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 193/398] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:31.151367 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4ec26-798d-4170-81a3-cf64bd08958e None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:31.159963 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31422a-4d64-4b0d-9cc0-06101ba6dbab None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:31.199860 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07dd62-5370-44b5-96a2-e21878cae698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:31.202006 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07dd62-5370-44b5-96a2-e21878cae698 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.206065 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07dd62-5370-44b5-96a2-e21878cae698 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.206525 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07dd62-5370-44b5-96a2-e21878cae698 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.227220 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07dd62-5370-44b5-96a2-e21878cae698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-be07dd62-5370-44b5-96a2-e21878cae698 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:31.235739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:31.236631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:31.237477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:31.250271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 206/399] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:42:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:31.256215 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07dd62-5370-44b5-96a2-e21878cae698 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:31.341976 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:31.377787 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4ec26-798d-4170-81a3-cf64bd08958e None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:31.383764 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07dd62-5370-44b5-96a2-e21878cae698 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:31.418998 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a7763-cf2c-4718-a080-3483f4bd2de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:31.419727 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a7763-cf2c-4718-a080-3483f4bd2de8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.420110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a7763-cf2c-4718-a080-3483f4bd2de8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.420486 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a7763-cf2c-4718-a080-3483f4bd2de8 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.421358 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a7763-cf2c-4718-a080-3483f4bd2de8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:31.421769 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a7763-cf2c-4718-a080-3483f4bd2de8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:31.423271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a7763-cf2c-4718-a080-3483f4bd2de8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:31.431619 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 207/400] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:31.437013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a7763-cf2c-4718-a080-3483f4bd2de8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:31.498909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778a6b2-016c-40fa-ae12-a108a9e8e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:31.499725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a6b2-016c-40fa-ae12-a108a9e8e4bf None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.500544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a6b2-016c-40fa-ae12-a108a9e8e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.500820 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a6b2-016c-40fa-ae12-a108a9e8e4bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.518106 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778a6b2-016c-40fa-ae12-a108a9e8e4bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-5778a6b2-016c-40fa-ae12-a108a9e8e4bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:31.526648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:31.527514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:31.528307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:31.531357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 194/401] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:31.532942 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55a981-a297-4e0d-bc1b-1d661f69768e None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.533437 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55a981-a297-4e0d-bc1b-1d661f69768e None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.533878 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55a981-a297-4e0d-bc1b-1d661f69768e None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.540166 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 195/402] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:31.541333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55a981-a297-4e0d-bc1b-1d661f69768e None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:31.546393 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a7763-cf2c-4718-a080-3483f4bd2de8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:31.560113 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:31.570455 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:31.582249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d0394-b3de-4fd1-823f-706490b43b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:31.583104 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0394-b3de-4fd1-823f-706490b43b13 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.583385 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0394-b3de-4fd1-823f-706490b43b13 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.583660 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d0394-b3de-4fd1-823f-706490b43b13 None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.584872 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d0394-b3de-4fd1-823f-706490b43b13 None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:31.586482 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d0394-b3de-4fd1-823f-706490b43b13 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:31.588208 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 208/403] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:31 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:31.593731 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9814743-8afc-48a2-8f4e-c40edce60834 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.594002 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9814743-8afc-48a2-8f4e-c40edce60834 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.594288 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9814743-8afc-48a2-8f4e-c40edce60834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.610978 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-b9814743-8afc-48a2-8f4e-c40edce60834 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:31.612155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-b9814743-8afc-48a2-8f4e-c40edce60834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:31.659229 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55a981-a297-4e0d-bc1b-1d661f69768e None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:31.689503 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 209/404] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:31.690334 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9814743-8afc-48a2-8f4e-c40edce60834 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:31.699281 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1808b2f-a0ac-4fae-b150-27637e5bbeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:31.700326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1808b2f-a0ac-4fae-b150-27637e5bbeb6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.700835 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1808b2f-a0ac-4fae-b150-27637e5bbeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.701362 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1808b2f-a0ac-4fae-b150-27637e5bbeb6 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.702418 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1808b2f-a0ac-4fae-b150-27637e5bbeb6 None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:31.702954 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1808b2f-a0ac-4fae-b150-27637e5bbeb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:31.704626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1808b2f-a0ac-4fae-b150-27637e5bbeb6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:31.714966 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 196/405] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:31.721081 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1808b2f-a0ac-4fae-b150-27637e5bbeb6 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:31.827991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:31.843310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9814743-8afc-48a2-8f4e-c40edce60834 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:31.853082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1808b2f-a0ac-4fae-b150-27637e5bbeb6 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:31.881893 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:31.897746 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67cdfe-1ad2-411b-965a-607c1e1efcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:31.898608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67cdfe-1ad2-411b-965a-607c1e1efcd5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.898869 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e1c8-053b-47ff-b059-8782153a9fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:31.899321 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67cdfe-1ad2-411b-965a-607c1e1efcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.899321 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67cdfe-1ad2-411b-965a-607c1e1efcd5 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.900312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67cdfe-1ad2-411b-965a-607c1e1efcd5 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:31.900705 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e1c8-053b-47ff-b059-8782153a9fe2 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.901152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e1c8-053b-47ff-b059-8782153a9fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.901615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e1c8-053b-47ff-b059-8782153a9fe2 None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.901782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67cdfe-1ad2-411b-965a-607c1e1efcd5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:31.903122 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57e1c8-053b-47ff-b059-8782153a9fe2 None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:31.903764 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 210/406] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:31 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:31.904593 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67cdfe-1ad2-411b-965a-607c1e1efcd5 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:31.905233 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57e1c8-053b-47ff-b059-8782153a9fe2 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:31.907815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 197/407] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:31 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:31.912107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12176ce-be46-4cd4-9942-3d207b949fbb None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:31.912107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12176ce-be46-4cd4-9942-3d207b949fbb None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:31.912107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12176ce-be46-4cd4-9942-3d207b949fbb None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:31.912870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 198/408] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:31.914352 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12176ce-be46-4cd4-9942-3d207b949fbb None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:32.024221 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12176ce-be46-4cd4-9942-3d207b949fbb None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:32.029902 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67cdfe-1ad2-411b-965a-607c1e1efcd5 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:32.061057 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e003e9-2231-4900-8e94-c8a4e6ed720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:32.061949 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e003e9-2231-4900-8e94-c8a4e6ed720e None admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.062237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e003e9-2231-4900-8e94-c8a4e6ed720e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.062499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e003e9-2231-4900-8e94-c8a4e6ed720e None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/groups/2fec6caeef9d49d991c81cd5959380c5/roles/3ca3c240900e4ca5865d244abf112295` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.064583 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2150d-4ff0-4d3b-9fb7-007f63213d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:32.064905 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e003e9-2231-4900-8e94-c8a4e6ed720e None admin] RBAC: Authorizing `identity:create_grant(project_id=eb5c54a62b6d4543b25bbf5d03cd319c, group_id=2fec6caeef9d49d991c81cd5959380c5, role_id=3ca3c240900e4ca5865d244abf112295)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:32.065389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2150d-4ff0-4d3b-9fb7-007f63213d92 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.065669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2150d-4ff0-4d3b-9fb7-007f63213d92 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.065941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2150d-4ff0-4d3b-9fb7-007f63213d92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.067021 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e003e9-2231-4900-8e94-c8a4e6ed720e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:32.077963 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2150d-4ff0-4d3b-9fb7-007f63213d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:32.082947 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 199/409] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Jul 12 18:42:31 2022] PUT /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/groups/2fec6caeef9d49d991c81cd5959380c5/roles/3ca3c240900e4ca5865d244abf112295 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:32.083622 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e003e9-2231-4900-8e94-c8a4e6ed720e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-44e2150d-4ff0-4d3b-9fb7-007f63213d92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:32.089335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:32.090353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:32.091139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 211/410] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:32.094405 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f325-fab4-495a-907b-5e77cc4b48e0 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.094757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f325-fab4-495a-907b-5e77cc4b48e0 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.095054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f325-fab4-495a-907b-5e77cc4b48e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.095982 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:32.132607 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-ff57f325-fab4-495a-907b-5e77cc4b48e0 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:32.133948 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-ff57f325-fab4-495a-907b-5e77cc4b48e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:32.191059 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:32.229738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 212/411] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:32.231027 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f325-fab4-495a-907b-5e77cc4b48e0 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:32.233196 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e003e9-2231-4900-8e94-c8a4e6ed720e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:32.278198 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8dabc-ad4a-45bd-a5cf-f1f0ed0310f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:32.278991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8dabc-ad4a-45bd-a5cf-f1f0ed0310f6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.279302 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8dabc-ad4a-45bd-a5cf-f1f0ed0310f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.279560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8dabc-ad4a-45bd-a5cf-f1f0ed0310f6 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.280715 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8dabc-ad4a-45bd-a5cf-f1f0ed0310f6 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:32.282995 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8dabc-ad4a-45bd-a5cf-f1f0ed0310f6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:32.284841 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 200/412] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:32 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:32.285476 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8dabc-ad4a-45bd-a5cf-f1f0ed0310f6 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:32.366375 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f325-fab4-495a-907b-5e77cc4b48e0 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:32.378474 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:32.413633 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8dabc-ad4a-45bd-a5cf-f1f0ed0310f6 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:32.418270 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c200c-8430-4549-a522-ddbd7f052029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:32.419255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c200c-8430-4549-a522-ddbd7f052029 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.419727 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c200c-8430-4549-a522-ddbd7f052029 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.420192 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c200c-8430-4549-a522-ddbd7f052029 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.421649 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c200c-8430-4549-a522-ddbd7f052029 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:32.422224 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c200c-8430-4549-a522-ddbd7f052029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:32.424737 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c200c-8430-4549-a522-ddbd7f052029 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:32.441319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 213/413] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:32.443165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c200c-8430-4549-a522-ddbd7f052029 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:32.454531 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78148dad-8dd3-4a93-8af0-31177c19b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:32.455387 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148dad-8dd3-4a93-8af0-31177c19b84c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.455679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148dad-8dd3-4a93-8af0-31177c19b84c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.455956 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148dad-8dd3-4a93-8af0-31177c19b84c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.467098 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78148dad-8dd3-4a93-8af0-31177c19b84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-78148dad-8dd3-4a93-8af0-31177c19b84c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:32.475457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:32.476344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:32.477124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:32.481435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 201/414] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:32.482341 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78148dad-8dd3-4a93-8af0-31177c19b84c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:32.503708 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:32.569503 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c200c-8430-4549-a522-ddbd7f052029 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:32.606254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abd3b3-74ea-4374-80df-0ba0a8483821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:32.607135 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abd3b3-74ea-4374-80df-0ba0a8483821 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.607415 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abd3b3-74ea-4374-80df-0ba0a8483821 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.607692 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abd3b3-74ea-4374-80df-0ba0a8483821 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/groups/2fec6caeef9d49d991c81cd5959380c5/roles/a6f65f08e2fc407cad745e9cd18f282d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.609810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abd3b3-74ea-4374-80df-0ba0a8483821 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb5c54a62b6d4543b25bbf5d03cd319c, group_id=2fec6caeef9d49d991c81cd5959380c5, role_id=a6f65f08e2fc407cad745e9cd18f282d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:32.611299 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abd3b3-74ea-4374-80df-0ba0a8483821 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:32.615664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78148dad-8dd3-4a93-8af0-31177c19b84c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:32.627074 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 214/415] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Jul 12 18:42:32 2022] PUT /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c/groups/2fec6caeef9d49d991c81cd5959380c5/roles/a6f65f08e2fc407cad745e9cd18f282d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:32.628591 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abd3b3-74ea-4374-80df-0ba0a8483821 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:32.657416 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:32.665524 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bac1cb-98f4-401f-9324-bd97659c804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:32.666591 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bac1cb-98f4-401f-9324-bd97659c804c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.667012 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bac1cb-98f4-401f-9324-bd97659c804c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.667571 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bac1cb-98f4-401f-9324-bd97659c804c None admin] PATH_INFO: `/v3/groups/1fdfa5a32f7f4eb697baba160be92c78` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.669722 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bac1cb-98f4-401f-9324-bd97659c804c None admin] RBAC: Authorizing `identity:get_group(group_id=1fdfa5a32f7f4eb697baba160be92c78)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:32.672116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bac1cb-98f4-401f-9324-bd97659c804c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:32.674459 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 202/416] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:32 2022] GET /identity/v3/groups/1fdfa5a32f7f4eb697baba160be92c78 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:32.680833 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bac1cb-98f4-401f-9324-bd97659c804c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:32.819988 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abd3b3-74ea-4374-80df-0ba0a8483821 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:32.826135 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:32.872600 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bac1cb-98f4-401f-9324-bd97659c804c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:32.889758 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8eca0-fc13-47c9-b0c6-be1d2c9ad113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:32.891834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8eca0-fc13-47c9-b0c6-be1d2c9ad113 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.892282 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8eca0-fc13-47c9-b0c6-be1d2c9ad113 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.892953 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8eca0-fc13-47c9-b0c6-be1d2c9ad113 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.894282 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8eca0-fc13-47c9-b0c6-be1d2c9ad113 None admin] RBAC: Adding query filter params (name=member) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:32.894755 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8eca0-fc13-47c9-b0c6-be1d2c9ad113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:32.897198 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8eca0-fc13-47c9-b0c6-be1d2c9ad113 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:32.907748 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 215/417] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:32.909158 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56793c2d-d998-4af8-9a8f-1d5956072e97 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.909546 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56793c2d-d998-4af8-9a8f-1d5956072e97 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.909912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56793c2d-d998-4af8-9a8f-1d5956072e97 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.911322 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 216/418] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:32.915766 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56793c2d-d998-4af8-9a8f-1d5956072e97 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:32.919381 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d41162b-252b-4217-8876-879833c07a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:32.920767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41162b-252b-4217-8876-879833c07a7f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.921239 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41162b-252b-4217-8876-879833c07a7f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.921726 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41162b-252b-4217-8876-879833c07a7f None admin] PATH_INFO: `/v3/projects/50ac8b5806ca4cab991abf52d2b9928f` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.923828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41162b-252b-4217-8876-879833c07a7f None admin] RBAC: Authorizing `identity:get_project(project_id=50ac8b5806ca4cab991abf52d2b9928f)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:32.925556 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d41162b-252b-4217-8876-879833c07a7f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:32.927789 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 203/419] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:32 2022] GET /identity/v3/projects/50ac8b5806ca4cab991abf52d2b9928f => generated 344 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:32.929248 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b644a-3dce-4fe2-afb5-52bf46b4dcae None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:32.929704 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b644a-3dce-4fe2-afb5-52bf46b4dcae None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:32.930114 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b644a-3dce-4fe2-afb5-52bf46b4dcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:32.950957 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-ed8b644a-3dce-4fe2-afb5-52bf46b4dcae None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:32.952676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-ed8b644a-3dce-4fe2-afb5-52bf46b4dcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:33.032743 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:33.043399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 204/420] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:33.044428 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b644a-3dce-4fe2-afb5-52bf46b4dcae None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:33.073146 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56793c2d-d998-4af8-9a8f-1d5956072e97 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:33.111814 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbb81b-40d4-46a7-954a-dd30d9fa1c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:33.112465 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbb81b-40d4-46a7-954a-dd30d9fa1c62 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:33.112750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbb81b-40d4-46a7-954a-dd30d9fa1c62 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:33.113027 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbb81b-40d4-46a7-954a-dd30d9fa1c62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:33.146281 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:33.158990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b644a-3dce-4fe2-afb5-52bf46b4dcae None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:33.184528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbb81b-40d4-46a7-954a-dd30d9fa1c62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:33.186039 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbb81b-40d4-46a7-954a-dd30d9fa1c62 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:33.198492 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc2004-ab8e-486e-ac8d-d55997265f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:33.199717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2004-ab8e-486e-ac8d-d55997265f72 None admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:33.200294 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2004-ab8e-486e-ac8d-d55997265f72 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:33.200881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2004-ab8e-486e-ac8d-d55997265f72 None admin] PATH_INFO: `/v3/projects/50ac8b5806ca4cab991abf52d2b9928f/groups/1fdfa5a32f7f4eb697baba160be92c78/roles/948b82ff28c547e78755c196cddfdd0e` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:33.203161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc2004-ab8e-486e-ac8d-d55997265f72 None admin] RBAC: Authorizing `identity:create_grant(project_id=50ac8b5806ca4cab991abf52d2b9928f, group_id=1fdfa5a32f7f4eb697baba160be92c78, role_id=948b82ff28c547e78755c196cddfdd0e)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:33.204986 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc2004-ab8e-486e-ac8d-d55997265f72 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:33.229569 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 205/421] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Jul 12 18:42:33 2022] PUT /identity/v3/projects/50ac8b5806ca4cab991abf52d2b9928f/groups/1fdfa5a32f7f4eb697baba160be92c78/roles/948b82ff28c547e78755c196cddfdd0e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:33.229569 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc2004-ab8e-486e-ac8d-d55997265f72 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:33.337718 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:33.348713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 217/422] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:33.355872 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbb81b-40d4-46a7-954a-dd30d9fa1c62 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:33.401260 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc2004-ab8e-486e-ac8d-d55997265f72 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:33.443129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cb077-6b78-4d36-9fa2-b70b614c38ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:33.444067 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cb077-6b78-4d36-9fa2-b70b614c38ee None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:33.444352 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cb077-6b78-4d36-9fa2-b70b614c38ee None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:33.444633 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cb077-6b78-4d36-9fa2-b70b614c38ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:33.461065 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cb077-6b78-4d36-9fa2-b70b614c38ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:33.472195 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-219cb077-6b78-4d36-9fa2-b70b614c38ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:33.474094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:33.477154 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:33.478082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 206/423] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:42:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:33.482478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cb077-6b78-4d36-9fa2-b70b614c38ee None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:33.532547 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbb81b-40d4-46a7-954a-dd30d9fa1c62 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:33.599990 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ce5b7-4a85-42b3-8ea4-7a8869026d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:33.602229 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ce5b7-4a85-42b3-8ea4-7a8869026d5b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:33.603687 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ce5b7-4a85-42b3-8ea4-7a8869026d5b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:33.604308 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ce5b7-4a85-42b3-8ea4-7a8869026d5b None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:33.607206 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ce5b7-4a85-42b3-8ea4-7a8869026d5b None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:33.608640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ce5b7-4a85-42b3-8ea4-7a8869026d5b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:33.616988 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 218/424] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:33 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:33.617430 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ce5b7-4a85-42b3-8ea4-7a8869026d5b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:33.650831 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cb077-6b78-4d36-9fa2-b70b614c38ee None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:33.669730 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:33.700448 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679c5d0-0495-446d-8206-3b5965b383ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:33.704506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679c5d0-0495-446d-8206-3b5965b383ab None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:33.704996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679c5d0-0495-446d-8206-3b5965b383ab None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:33.705465 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679c5d0-0495-446d-8206-3b5965b383ab None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:33.706485 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679c5d0-0495-446d-8206-3b5965b383ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:33.706975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679c5d0-0495-446d-8206-3b5965b383ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:33.708513 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679c5d0-0495-446d-8206-3b5965b383ab None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:33.729577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 207/425] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:33.733025 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679c5d0-0495-446d-8206-3b5965b383ab None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:33.800198 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ce5b7-4a85-42b3-8ea4-7a8869026d5b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:33.832261 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:33.838515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe38da-5053-4d6c-a895-3a956fd51618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:33.839373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe38da-5053-4d6c-a895-3a956fd51618 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:33.839712 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe38da-5053-4d6c-a895-3a956fd51618 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:33.840154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe38da-5053-4d6c-a895-3a956fd51618 None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:33.841413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe38da-5053-4d6c-a895-3a956fd51618 None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:33.842884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe38da-5053-4d6c-a895-3a956fd51618 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:33.845426 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 219/426] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:33 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:33.854301 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe38da-5053-4d6c-a895-3a956fd51618 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:33.925318 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679c5d0-0495-446d-8206-3b5965b383ab None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:33.954629 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218167c1-82ee-4c65-8264-87797f87c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:33.955281 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218167c1-82ee-4c65-8264-87797f87c168 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:33.955560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218167c1-82ee-4c65-8264-87797f87c168 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:33.955830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218167c1-82ee-4c65-8264-87797f87c168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:34.005439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:34.033338 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe38da-5053-4d6c-a895-3a956fd51618 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:34.036881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218167c1-82ee-4c65-8264-87797f87c168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:34.038622 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218167c1-82ee-4c65-8264-87797f87c168 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:34.098291 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa3313-fd4e-47e7-9b16-7134588d2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:34.099263 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa3313-fd4e-47e7-9b16-7134588d2e96 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:34.099680 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa3313-fd4e-47e7-9b16-7134588d2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:34.100118 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa3313-fd4e-47e7-9b16-7134588d2e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:34.101081 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa3313-fd4e-47e7-9b16-7134588d2e96 None admin] RBAC: Adding query filter params (group.id=2fec6caeef9d49d991c81cd5959380c5, role.id=a6f65f08e2fc407cad745e9cd18f282d, scope.project.id=e7415ae7a8bf412685572674e06f9d13) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:34.101554 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa3313-fd4e-47e7-9b16-7134588d2e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:34.103366 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa3313-fd4e-47e7-9b16-7134588d2e96 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:34.119239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 220/427] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Jul 12 18:42:33 2022] GET /identity/v3/role_assignments?group.id=2fec6caeef9d49d991c81cd5959380c5&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 611 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:34.181835 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 208/428] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:34.190324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa3313-fd4e-47e7-9b16-7134588d2e96 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:34.276162 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:34.325004 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa3313-fd4e-47e7-9b16-7134588d2e96 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:34.362872 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ed289-bddb-409a-9b48-8de23be234fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:34.363942 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ed289-bddb-409a-9b48-8de23be234fd None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:34.364391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ed289-bddb-409a-9b48-8de23be234fd None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:34.364801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ed289-bddb-409a-9b48-8de23be234fd None admin] PATH_INFO: `/v3/projects/e7415ae7a8bf412685572674e06f9d13` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:34.366147 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ed289-bddb-409a-9b48-8de23be234fd None admin] RBAC: Authorizing `identity:get_project(project_id=e7415ae7a8bf412685572674e06f9d13)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:34.367732 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ed289-bddb-409a-9b48-8de23be234fd None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:34.369685 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 221/429] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:34 2022] GET /identity/v3/projects/e7415ae7a8bf412685572674e06f9d13 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:34.376866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218167c1-82ee-4c65-8264-87797f87c168 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:34.474798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:34.502774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218167c1-82ee-4c65-8264-87797f87c168 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:34.547616 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2940f-702c-46f6-8016-f1c04e2febb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:34.548483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2940f-702c-46f6-8016-f1c04e2febb5 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:34.548764 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2940f-702c-46f6-8016-f1c04e2febb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:34.549045 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2940f-702c-46f6-8016-f1c04e2febb5 None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:34.550298 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2940f-702c-46f6-8016-f1c04e2febb5 None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:34.551795 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2940f-702c-46f6-8016-f1c04e2febb5 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:34.553458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 209/430] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:34 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:34.559358 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ed289-bddb-409a-9b48-8de23be234fd None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:34.630517 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c3c6-8698-4d7d-8624-3cae960994cc None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:34.630517 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c3c6-8698-4d7d-8624-3cae960994cc None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:34.630517 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201c3c6-8698-4d7d-8624-3cae960994cc None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:34.631764 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 210/431] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:34.636937 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028734-3407-4c86-a5e0-8a605cffd214 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:34.637222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028734-3407-4c86-a5e0-8a605cffd214 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:34.637521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028734-3407-4c86-a5e0-8a605cffd214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:34.662360 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-22028734-3407-4c86-a5e0-8a605cffd214 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:34.663690 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-22028734-3407-4c86-a5e0-8a605cffd214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:34.693463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ed289-bddb-409a-9b48-8de23be234fd None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:34.726365 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:34.732075 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c989fa0-4235-4674-bda4-deb1835a39ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:34.733091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c989fa0-4235-4674-bda4-deb1835a39ea None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:34.733607 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c989fa0-4235-4674-bda4-deb1835a39ea None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:34.734334 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c989fa0-4235-4674-bda4-deb1835a39ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:34.735421 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c989fa0-4235-4674-bda4-deb1835a39ea None admin] RBAC: Adding query filter params (group.id=2fec6caeef9d49d991c81cd5959380c5, role.id=3ca3c240900e4ca5865d244abf112295, scope.project.id=e7415ae7a8bf412685572674e06f9d13) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:34.735972 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c989fa0-4235-4674-bda4-deb1835a39ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:34.737717 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c989fa0-4235-4674-bda4-deb1835a39ea None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:34.745021 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 222/432] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Jul 12 18:42:34 2022] GET /identity/v3/role_assignments?group.id=2fec6caeef9d49d991c81cd5959380c5&scope.project.id=e7415ae7a8bf412685572674e06f9d13&role.id=3ca3c240900e4ca5865d244abf112295 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:34.763226 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 211/433] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:34.790707 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c989fa0-4235-4674-bda4-deb1835a39ea None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:34.904196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c989fa0-4235-4674-bda4-deb1835a39ea None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:34.943047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467915fd-f995-4993-a3b6-54e36a97e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:34.944245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467915fd-f995-4993-a3b6-54e36a97e897 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:34.944732 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467915fd-f995-4993-a3b6-54e36a97e897 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:34.945230 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467915fd-f995-4993-a3b6-54e36a97e897 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:34.957254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467915fd-f995-4993-a3b6-54e36a97e897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-467915fd-f995-4993-a3b6-54e36a97e897 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:34.971744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:34.972709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:34.973578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 223/434] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:42:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:34.982285 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028734-3407-4c86-a5e0-8a605cffd214 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:35.080102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:35.105174 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22028734-3407-4c86-a5e0-8a605cffd214 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:35.142657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1fe75-81dc-405c-863e-3284b4f2ab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:35.143564 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1fe75-81dc-405c-863e-3284b4f2ab20 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.143994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1fe75-81dc-405c-863e-3284b4f2ab20 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.144416 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1fe75-81dc-405c-863e-3284b4f2ab20 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.145329 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1fe75-81dc-405c-863e-3284b4f2ab20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:35.145778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1fe75-81dc-405c-863e-3284b4f2ab20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:35.147314 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1fe75-81dc-405c-863e-3284b4f2ab20 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:35.157658 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 212/435] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:35.163801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467915fd-f995-4993-a3b6-54e36a97e897 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:35.227920 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:35.274086 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467915fd-f995-4993-a3b6-54e36a97e897 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:35.310341 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d974f-fd2d-4eda-801d-d399784511d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:35.311005 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d974f-fd2d-4eda-801d-d399784511d2 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.311290 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d974f-fd2d-4eda-801d-d399784511d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.311570 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d974f-fd2d-4eda-801d-d399784511d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.348323 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405b78c-98c4-46b8-927a-bb9a35ae0ad9 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.348645 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405b78c-98c4-46b8-927a-bb9a35ae0ad9 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.348891 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405b78c-98c4-46b8-927a-bb9a35ae0ad9 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.350431 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 213/436] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:35.355318 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf9733-3d0d-489b-83f6-1698206cda74 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.355601 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf9733-3d0d-489b-83f6-1698206cda74 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.355875 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf9733-3d0d-489b-83f6-1698206cda74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.372944 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-e2bf9733-3d0d-489b-83f6-1698206cda74 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:35.374151 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-e2bf9733-3d0d-489b-83f6-1698206cda74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:35.384540 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d974f-fd2d-4eda-801d-d399784511d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:35.386026 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d974f-fd2d-4eda-801d-d399784511d2 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:35.445122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:35.447594 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 214/437] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:35.471700 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf9733-3d0d-489b-83f6-1698206cda74 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:35.493194 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 224/438] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:35.498395 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d974f-fd2d-4eda-801d-d399784511d2 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:35.544191 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:35.578752 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf9733-3d0d-489b-83f6-1698206cda74 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:35.607919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d974f-fd2d-4eda-801d-d399784511d2 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:35.614030 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1a47c-89f4-44b0-aac8-ba73b854e165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:35.614821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1a47c-89f4-44b0-aac8-ba73b854e165 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.615102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1a47c-89f4-44b0-aac8-ba73b854e165 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.615375 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1a47c-89f4-44b0-aac8-ba73b854e165 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.627398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1a47c-89f4-44b0-aac8-ba73b854e165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-f7c1a47c-89f4-44b0-aac8-ba73b854e165 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:35.635736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:35.636624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:35.637725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 215/439] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:35.642745 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1a47c-89f4-44b0-aac8-ba73b854e165 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:35.644342 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bcb0d-529d-4341-b957-555bc3298cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:35.645211 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcb0d-529d-4341-b957-555bc3298cff None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.645526 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcb0d-529d-4341-b957-555bc3298cff None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.645796 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bcb0d-529d-4341-b957-555bc3298cff None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.647035 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bcb0d-529d-4341-b957-555bc3298cff None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:35.648501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bcb0d-529d-4341-b957-555bc3298cff None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:35.650368 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 225/440] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:35 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:35.656388 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bcb0d-529d-4341-b957-555bc3298cff None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:35.685156 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:35.759175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1a47c-89f4-44b0-aac8-ba73b854e165 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:35.762520 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bcb0d-529d-4341-b957-555bc3298cff None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:35.789064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:35.795861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963552a2-2178-4bd6-9950-7e7105b68654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:35.796606 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963552a2-2178-4bd6-9950-7e7105b68654 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.797493 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963552a2-2178-4bd6-9950-7e7105b68654 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.797774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963552a2-2178-4bd6-9950-7e7105b68654 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.798543 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963552a2-2178-4bd6-9950-7e7105b68654 None admin] RBAC: Adding query filter params (name=member) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:35.798850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963552a2-2178-4bd6-9950-7e7105b68654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:35.800218 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963552a2-2178-4bd6-9950-7e7105b68654 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:35.800669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5d72f-51a1-4592-9f78-c8bcfb9de995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:35.801561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5d72f-51a1-4592-9f78-c8bcfb9de995 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.801846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5d72f-51a1-4592-9f78-c8bcfb9de995 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.802126 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5d72f-51a1-4592-9f78-c8bcfb9de995 None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.803314 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5d72f-51a1-4592-9f78-c8bcfb9de995 None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:35.804735 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5d72f-51a1-4592-9f78-c8bcfb9de995 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:35.811013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 226/441] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:35 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:35.811146 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 216/442] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:42:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:35.814309 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5d72f-51a1-4592-9f78-c8bcfb9de995 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:35.814761 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a0832-35c5-4cbf-a5cb-91754bd9c682 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.815052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a0832-35c5-4cbf-a5cb-91754bd9c682 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.815353 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a0832-35c5-4cbf-a5cb-91754bd9c682 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.816744 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 217/443] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:35.817459 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a0832-35c5-4cbf-a5cb-91754bd9c682 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:35.908615 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:35.917474 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5d72f-51a1-4592-9f78-c8bcfb9de995 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:35.919277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a0832-35c5-4cbf-a5cb-91754bd9c682 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:35.950498 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750fa43-62f0-421b-9c41-367f8f42d7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:35.951143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750fa43-62f0-421b-9c41-367f8f42d7ee None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.951432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750fa43-62f0-421b-9c41-367f8f42d7ee None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.951616 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0da412-0601-4d2b-a2ed-eab8c403f36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:35.951812 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750fa43-62f0-421b-9c41-367f8f42d7ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.952249 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da412-0601-4d2b-a2ed-eab8c403f36f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.952516 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750fa43-62f0-421b-9c41-367f8f42d7ee None admin] RBAC: Adding query filter params (group.id=2fec6caeef9d49d991c81cd5959380c5, role.id=3ca3c240900e4ca5865d244abf112295, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:35.952605 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da412-0601-4d2b-a2ed-eab8c403f36f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.952787 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0da412-0601-4d2b-a2ed-eab8c403f36f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.952880 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750fa43-62f0-421b-9c41-367f8f42d7ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:35.954312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750fa43-62f0-421b-9c41-367f8f42d7ee None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:35.960015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 227/444] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Jul 12 18:42:35 2022] GET /identity/v3/role_assignments?group.id=2fec6caeef9d49d991c81cd5959380c5&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=3ca3c240900e4ca5865d244abf112295 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:35.961190 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d08a73-e15b-4c6a-ac1b-839686f47d03 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:35.961509 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d08a73-e15b-4c6a-ac1b-839686f47d03 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:35.961795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d08a73-e15b-4c6a-ac1b-839686f47d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:35.980882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-a1d08a73-e15b-4c6a-ac1b-839686f47d03 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:35.982551 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-a1d08a73-e15b-4c6a-ac1b-839686f47d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:36.026633 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:36.041078 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0da412-0601-4d2b-a2ed-eab8c403f36f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:36.042604 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0da412-0601-4d2b-a2ed-eab8c403f36f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:36.064123 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 228/445] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:36.088941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d08a73-e15b-4c6a-ac1b-839686f47d03 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:36.166346 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 218/446] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:36.172185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0da412-0601-4d2b-a2ed-eab8c403f36f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:36.186843 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:36.203967 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d08a73-e15b-4c6a-ac1b-839686f47d03 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:36.238132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ad693-c0b8-4b2d-9178-a4f4dced87b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:36.238919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ad693-c0b8-4b2d-9178-a4f4dced87b6 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:36.239206 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ad693-c0b8-4b2d-9178-a4f4dced87b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:36.239474 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ad693-c0b8-4b2d-9178-a4f4dced87b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:36.249432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ad693-c0b8-4b2d-9178-a4f4dced87b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-679ad693-c0b8-4b2d-9178-a4f4dced87b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:36.258434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:36.259381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:36.260164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 229/447] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:36.265446 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ad693-c0b8-4b2d-9178-a4f4dced87b6 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:36.268959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:36.279948 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0da412-0601-4d2b-a2ed-eab8c403f36f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:36.316692 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9fd45-8290-4fbe-878b-1190ebf896c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:36.317567 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9fd45-8290-4fbe-878b-1190ebf896c7 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:36.317846 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9fd45-8290-4fbe-878b-1190ebf896c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:36.318118 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9fd45-8290-4fbe-878b-1190ebf896c7 None admin] PATH_INFO: `/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:36.319283 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9fd45-8290-4fbe-878b-1190ebf896c7 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5c54a62b6d4543b25bbf5d03cd319c)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:36.320722 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9fd45-8290-4fbe-878b-1190ebf896c7 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:36.322422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 219/448] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:36 2022] GET /identity/v3/projects/eb5c54a62b6d4543b25bbf5d03cd319c => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:36.327828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9fd45-8290-4fbe-878b-1190ebf896c7 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:36.365027 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ad693-c0b8-4b2d-9178-a4f4dced87b6 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:36.398611 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8d187-d903-419e-b05e-c2f24176d5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:36.399267 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d187-d903-419e-b05e-c2f24176d5c5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:36.399551 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d187-d903-419e-b05e-c2f24176d5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:36.399828 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d187-d903-419e-b05e-c2f24176d5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:36.400566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8d187-d903-419e-b05e-c2f24176d5c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:36.400867 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8d187-d903-419e-b05e-c2f24176d5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:36.402298 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8d187-d903-419e-b05e-c2f24176d5c5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:36.410681 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 230/449] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:36.416084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8d187-d903-419e-b05e-c2f24176d5c5 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:36.424514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9fd45-8290-4fbe-878b-1190ebf896c7 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:36.427894 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:36.458054 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e457f-ca7c-44fb-84f1-ef4d5e35917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:36.458899 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e457f-ca7c-44fb-84f1-ef4d5e35917b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:36.459180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e457f-ca7c-44fb-84f1-ef4d5e35917b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:36.459453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e457f-ca7c-44fb-84f1-ef4d5e35917b None admin] PATH_INFO: `/v3/groups/2fec6caeef9d49d991c81cd5959380c5` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:36.460613 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e457f-ca7c-44fb-84f1-ef4d5e35917b None admin] RBAC: Authorizing `identity:get_group(group_id=2fec6caeef9d49d991c81cd5959380c5)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:36.462081 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e457f-ca7c-44fb-84f1-ef4d5e35917b None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:36.463684 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 220/450] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:36 2022] GET /identity/v3/groups/2fec6caeef9d49d991c81cd5959380c5 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:36.469237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e457f-ca7c-44fb-84f1-ef4d5e35917b None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:36.496074 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:36.514952 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8d187-d903-419e-b05e-c2f24176d5c5 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:36.548608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a8d23-4f6a-4ffe-917c-d1db9ee8e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:36.549180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a8d23-4f6a-4ffe-917c-d1db9ee8e3b6 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:36.549485 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a8d23-4f6a-4ffe-917c-d1db9ee8e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:36.549757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a8d23-4f6a-4ffe-917c-d1db9ee8e3b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:36.568174 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e457f-ca7c-44fb-84f1-ef4d5e35917b None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:36.606494 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d2b56-e98c-4d23-b9d7-405bfe5d2b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:36.607144 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d2b56-e98c-4d23-b9d7-405bfe5d2b6a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:36.607430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d2b56-e98c-4d23-b9d7-405bfe5d2b6a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:36.607699 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d2b56-e98c-4d23-b9d7-405bfe5d2b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:36.608521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d2b56-e98c-4d23-b9d7-405bfe5d2b6a None admin] RBAC: Adding query filter params (group.id=2fec6caeef9d49d991c81cd5959380c5, role.id=a6f65f08e2fc407cad745e9cd18f282d, scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:36.608826 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d2b56-e98c-4d23-b9d7-405bfe5d2b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:36.610879 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d2b56-e98c-4d23-b9d7-405bfe5d2b6a None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:36.616758 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 221/451] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Jul 12 18:42:36 2022] GET /identity/v3/role_assignments?group.id=2fec6caeef9d49d991c81cd5959380c5&scope.project.id=eb5c54a62b6d4543b25bbf5d03cd319c&role.id=a6f65f08e2fc407cad745e9cd18f282d => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:36.617081 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a8d23-4f6a-4ffe-917c-d1db9ee8e3b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:36.618570 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a8d23-4f6a-4ffe-917c-d1db9ee8e3b6 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:36.629928 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:36.724509 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 231/452] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:42:36.730118 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d2b56-e98c-4d23-b9d7-405bfe5d2b6a None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:36.826682 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:36.836570 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d2b56-e98c-4d23-b9d7-405bfe5d2b6a None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:36.870328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a16f3-6178-4cfb-87c1-50bd09488438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:36.871191 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a16f3-6178-4cfb-87c1-50bd09488438 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:36.871478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a16f3-6178-4cfb-87c1-50bd09488438 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:36.871751 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a16f3-6178-4cfb-87c1-50bd09488438 None admin] PATH_INFO: `/v3/projects/50ac8b5806ca4cab991abf52d2b9928f` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:36.872927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a16f3-6178-4cfb-87c1-50bd09488438 None admin] RBAC: Authorizing `identity:get_project(project_id=50ac8b5806ca4cab991abf52d2b9928f)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:36.874396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a16f3-6178-4cfb-87c1-50bd09488438 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:36.877195 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 222/453] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Jul 12 18:42:36 2022] GET /identity/v3/projects/50ac8b5806ca4cab991abf52d2b9928f => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:36.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a8d23-4f6a-4ffe-917c-d1db9ee8e3b6 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:36.979983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a8d23-4f6a-4ffe-917c-d1db9ee8e3b6 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:36.989781 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:37.015209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f4596-40dd-4537-9638-1f0c8f318e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:37.016083 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4596-40dd-4537-9638-1f0c8f318e5d None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:37.016362 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4596-40dd-4537-9638-1f0c8f318e5d None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:37.016632 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f4596-40dd-4537-9638-1f0c8f318e5d None admin] PATH_INFO: `/v3/groups/1fdfa5a32f7f4eb697baba160be92c78` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:37.017818 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f4596-40dd-4537-9638-1f0c8f318e5d None admin] RBAC: Authorizing `identity:get_group(group_id=1fdfa5a32f7f4eb697baba160be92c78)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:37.019247 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f4596-40dd-4537-9638-1f0c8f318e5d None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:37.020884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 232/454] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Jul 12 18:42:36 2022] GET /identity/v3/groups/1fdfa5a32f7f4eb697baba160be92c78 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:37.026914 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a16f3-6178-4cfb-87c1-50bd09488438 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:37.130831 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a16f3-6178-4cfb-87c1-50bd09488438 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:37.162258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254faf46-0d0b-4ee5-8ef0-9f7aad92bbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:37.162896 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254faf46-0d0b-4ee5-8ef0-9f7aad92bbca None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:37.163175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254faf46-0d0b-4ee5-8ef0-9f7aad92bbca None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:37.163448 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254faf46-0d0b-4ee5-8ef0-9f7aad92bbca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:37.164257 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254faf46-0d0b-4ee5-8ef0-9f7aad92bbca None admin] RBAC: Adding query filter params (group.id=1fdfa5a32f7f4eb697baba160be92c78, role.id=948b82ff28c547e78755c196cddfdd0e, scope.project.id=50ac8b5806ca4cab991abf52d2b9928f) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:37.164564 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254faf46-0d0b-4ee5-8ef0-9f7aad92bbca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:37.166017 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254faf46-0d0b-4ee5-8ef0-9f7aad92bbca None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:37.172576 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 223/455] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Jul 12 18:42:37 2022] GET /identity/v3/role_assignments?group.id=1fdfa5a32f7f4eb697baba160be92c78&scope.project.id=50ac8b5806ca4cab991abf52d2b9928f&role.id=948b82ff28c547e78755c196cddfdd0e => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:39.726524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01611f-18ea-4132-8d26-3c3c6ddc22b4 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:39.727036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01611f-18ea-4132-8d26-3c3c6ddc22b4 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:39.727036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01611f-18ea-4132-8d26-3c3c6ddc22b4 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:39.728740 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 233/456] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:39.734119 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013182-f80d-445e-bd18-2a96f9220518 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:39.734557 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013182-f80d-445e-bd18-2a96f9220518 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:39.734726 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13013182-f80d-445e-bd18-2a96f9220518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:39.752395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-13013182-f80d-445e-bd18-2a96f9220518 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:39.753594 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-13013182-f80d-445e-bd18-2a96f9220518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:39.771730 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:39.822196 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 224/457] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:39.848497 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01611f-18ea-4132-8d26-3c3c6ddc22b4 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:39.852969 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bac6f2-0906-403a-864d-994b733f3abc None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:39.853329 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bac6f2-0906-403a-864d-994b733f3abc None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:39.853622 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bac6f2-0906-403a-864d-994b733f3abc None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:39.855343 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 225/458] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:42:39.863589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ec7e8-c720-4b4d-9b69-fb243f2221fd None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:39.863883 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ec7e8-c720-4b4d-9b69-fb243f2221fd None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:39.864153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ec7e8-c720-4b4d-9b69-fb243f2221fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:39.892442 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-561ec7e8-c720-4b4d-9b69-fb243f2221fd None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:39.894225 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-561ec7e8-c720-4b4d-9b69-fb243f2221fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:39.974830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 226/459] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:39.990023 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01611f-18ea-4132-8d26-3c3c6ddc22b4 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:40.001941 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ec7e8-c720-4b4d-9b69-fb243f2221fd None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:40.028261 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70589188-62da-46dc-9a82-1cb3cb5d3c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:40.029060 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589188-62da-46dc-9a82-1cb3cb5d3c1d None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.029372 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589188-62da-46dc-9a82-1cb3cb5d3c1d None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.029652 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589188-62da-46dc-9a82-1cb3cb5d3c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.041710 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70589188-62da-46dc-9a82-1cb3cb5d3c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:40.043228 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70589188-62da-46dc-9a82-1cb3cb5d3c1d None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-70589188-62da-46dc-9a82-1cb3cb5d3c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:40.063912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:40.064861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:40.069937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:40.069937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:40.069937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:40.069937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:40.069937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 234/460] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:40.069937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d138dc-7037-456a-888c-1e5b89b9aca0 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.069937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d138dc-7037-456a-888c-1e5b89b9aca0 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.069937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d138dc-7037-456a-888c-1e5b89b9aca0 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.069937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 235/461] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:40.073316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d138dc-7037-456a-888c-1e5b89b9aca0 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:40.096461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:40.103305 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:40.122705 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ec7e8-c720-4b4d-9b69-fb243f2221fd None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:40.160088 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc89bfd-72eb-4341-aae0-83b36be7377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:40.160882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc89bfd-72eb-4341-aae0-83b36be7377f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.161160 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc89bfd-72eb-4341-aae0-83b36be7377f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.161465 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc89bfd-72eb-4341-aae0-83b36be7377f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.173529 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc89bfd-72eb-4341-aae0-83b36be7377f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:40.174973 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc89bfd-72eb-4341-aae0-83b36be7377f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:40.191520 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d138dc-7037-456a-888c-1e5b89b9aca0 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-7dc89bfd-72eb-4341-aae0-83b36be7377f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:40.193023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:40.193856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:40.194701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:40.194701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:40.194701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:40.194701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:40.194701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 227/462] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:40.198565 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343af2f9-0018-40cc-b776-73c63d575fcb None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.199103 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343af2f9-0018-40cc-b776-73c63d575fcb None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.199387 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343af2f9-0018-40cc-b776-73c63d575fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.216567 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-343af2f9-0018-40cc-b776-73c63d575fcb None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:40.217813 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-343af2f9-0018-40cc-b776-73c63d575fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:40.227620 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609e71e-cef7-4a0b-8e95-4d3dd5e35468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:40.228272 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609e71e-cef7-4a0b-8e95-4d3dd5e35468 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.228557 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609e71e-cef7-4a0b-8e95-4d3dd5e35468 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.228832 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609e71e-cef7-4a0b-8e95-4d3dd5e35468 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.229586 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609e71e-cef7-4a0b-8e95-4d3dd5e35468 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:40.229893 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609e71e-cef7-4a0b-8e95-4d3dd5e35468 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:40.231241 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609e71e-cef7-4a0b-8e95-4d3dd5e35468 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:40.242957 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 236/463] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:40.243596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609e71e-cef7-4a0b-8e95-4d3dd5e35468 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:40.284668 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 228/464] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:40.286009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832c51-7150-463d-96c5-60907679343a None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.286293 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832c51-7150-463d-96c5-60907679343a None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.286566 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa832c51-7150-463d-96c5-60907679343a None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.287803 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 229/465] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:40.288470 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa832c51-7150-463d-96c5-60907679343a None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:40.338774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:40.351345 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609e71e-cef7-4a0b-8e95-4d3dd5e35468 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:40.363499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:40.385126 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163aac6-83cd-48b1-b35c-c23deb9c73c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:40.385830 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163aac6-83cd-48b1-b35c-c23deb9c73c2 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.386113 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163aac6-83cd-48b1-b35c-c23deb9c73c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.386388 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163aac6-83cd-48b1-b35c-c23deb9c73c2 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.387105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163aac6-83cd-48b1-b35c-c23deb9c73c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:40.387412 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163aac6-83cd-48b1-b35c-c23deb9c73c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:40.388776 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163aac6-83cd-48b1-b35c-c23deb9c73c2 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:40.399567 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa832c51-7150-463d-96c5-60907679343a None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:40.399996 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 237/466] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:40.401206 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670100ac-8c45-4639-b5ad-23b9a15f17ab None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.401527 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670100ac-8c45-4639-b5ad-23b9a15f17ab None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.402446 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670100ac-8c45-4639-b5ad-23b9a15f17ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.418529 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-670100ac-8c45-4639-b5ad-23b9a15f17ab None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:40.419714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-670100ac-8c45-4639-b5ad-23b9a15f17ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:40.433644 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f361b-f887-4c28-8f13-82d3ea429bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:40.434490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f361b-f887-4c28-8f13-82d3ea429bbd None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.434777 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f361b-f887-4c28-8f13-82d3ea429bbd None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.435056 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f361b-f887-4c28-8f13-82d3ea429bbd None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.435750 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f361b-f887-4c28-8f13-82d3ea429bbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:40.437232 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f361b-f887-4c28-8f13-82d3ea429bbd None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:40.455773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 230/467] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:42:40 2022] POST /identity/v3/users => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:42:40.456560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f361b-f887-4c28-8f13-82d3ea429bbd None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:40.492145 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 238/468] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:40.493335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670100ac-8c45-4639-b5ad-23b9a15f17ab None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:40.576707 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f361b-f887-4c28-8f13-82d3ea429bbd None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:40.597867 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:40.603312 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:40.618671 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579c2a7-1095-4a13-903c-2d00ed880c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:40.619492 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579c2a7-1095-4a13-903c-2d00ed880c13 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.619775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579c2a7-1095-4a13-903c-2d00ed880c13 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.620050 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579c2a7-1095-4a13-903c-2d00ed880c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.628970 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670100ac-8c45-4639-b5ad-23b9a15f17ab None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:40.632265 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579c2a7-1095-4a13-903c-2d00ed880c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:40.633767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579c2a7-1095-4a13-903c-2d00ed880c13 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-e579c2a7-1095-4a13-903c-2d00ed880c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:40.653611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:40.654544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:40.656581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:40.656581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:40.656581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:40.656581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:40.656581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 231/469] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:40.656581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579c2a7-1095-4a13-903c-2d00ed880c13 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:40.674885 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f8640-2fcd-47c0-a192-4276fb518997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:40.676153 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f8640-2fcd-47c0-a192-4276fb518997 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.676615 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f8640-2fcd-47c0-a192-4276fb518997 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.677231 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f8640-2fcd-47c0-a192-4276fb518997 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.678536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f8640-2fcd-47c0-a192-4276fb518997 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:40.680421 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f8640-2fcd-47c0-a192-4276fb518997 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:40.701931 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 239/470] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:42:40 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:42:40.703459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f8640-2fcd-47c0-a192-4276fb518997 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:40.777081 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579c2a7-1095-4a13-903c-2d00ed880c13 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:40.818237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d9fb2-0d3a-404d-8661-fdd657f3ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:40.819368 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d9fb2-0d3a-404d-8661-fdd657f3ab1c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.819652 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d9fb2-0d3a-404d-8661-fdd657f3ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.819931 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d9fb2-0d3a-404d-8661-fdd657f3ab1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.833005 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d9fb2-0d3a-404d-8661-fdd657f3ab1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:40.834531 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d9fb2-0d3a-404d-8661-fdd657f3ab1c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:40.847819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f8640-2fcd-47c0-a192-4276fb518997 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-b21d9fb2-0d3a-404d-8661-fdd657f3ab1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:40.852872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:40.853774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:40.854697 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:40.854697 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:40.854697 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:40.854697 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:40.854697 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 232/471] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:40.862972 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d9fb2-0d3a-404d-8661-fdd657f3ab1c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:40.905310 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:40.913934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77943c70-20aa-46df-a239-d087134309ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:40.914981 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77943c70-20aa-46df-a239-d087134309ff None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:40.915265 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77943c70-20aa-46df-a239-d087134309ff None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:40.915539 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77943c70-20aa-46df-a239-d087134309ff None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:40.916380 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77943c70-20aa-46df-a239-d087134309ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:40.916859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77943c70-20aa-46df-a239-d087134309ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:40.919243 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77943c70-20aa-46df-a239-d087134309ff None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:40.920855 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:40.937808 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 240/472] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:40.943633 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77943c70-20aa-46df-a239-d087134309ff None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:41.010025 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d9fb2-0d3a-404d-8661-fdd657f3ab1c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:41.051105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696af8b0-de4f-4320-a636-367431cde9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:41.051744 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696af8b0-de4f-4320-a636-367431cde9d9 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:41.052032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696af8b0-de4f-4320-a636-367431cde9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:41.052306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696af8b0-de4f-4320-a636-367431cde9d9 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:41.053090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696af8b0-de4f-4320-a636-367431cde9d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:41.053422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696af8b0-de4f-4320-a636-367431cde9d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:41.054808 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696af8b0-de4f-4320-a636-367431cde9d9 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:41.060532 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77943c70-20aa-46df-a239-d087134309ff None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:41.067558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 233/473] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:41.075907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696af8b0-de4f-4320-a636-367431cde9d9 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:41.106131 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5b793-7a40-4661-b1b2-3bde508a998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:41.106807 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b793-7a40-4661-b1b2-3bde508a998e None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:41.107091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b793-7a40-4661-b1b2-3bde508a998e None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:41.107514 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5b793-7a40-4661-b1b2-3bde508a998e None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:41.108815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5b793-7a40-4661-b1b2-3bde508a998e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:41.111520 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5b793-7a40-4661-b1b2-3bde508a998e None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:41.153312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 241/474] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:42:40 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:42:41.188559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:41.208113 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696af8b0-de4f-4320-a636-367431cde9d9 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:41.250464 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a855-9bc9-4eda-9510-36ac0031c387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:41.251212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a855-9bc9-4eda-9510-36ac0031c387 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:41.251497 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a855-9bc9-4eda-9510-36ac0031c387 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:41.251773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a855-9bc9-4eda-9510-36ac0031c387 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:41.252484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4a855-9bc9-4eda-9510-36ac0031c387 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:41.254131 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4a855-9bc9-4eda-9510-36ac0031c387 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:41.280294 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 234/475] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:42:41 2022] POST /identity/v3/users => generated 249 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:42:42.798105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba46a2-63df-40f9-b971-caac4845138a None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:42.798663 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba46a2-63df-40f9-b971-caac4845138a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:42.798663 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba46a2-63df-40f9-b971-caac4845138a None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:42.800261 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 242/476] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:42.805564 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeae8ef-a741-418e-95fc-3deba87547f5 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:42.806382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeae8ef-a741-418e-95fc-3deba87547f5 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:42.806878 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeae8ef-a741-418e-95fc-3deba87547f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:42.824112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-afeae8ef-a741-418e-95fc-3deba87547f5 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:42.825653 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-afeae8ef-a741-418e-95fc-3deba87547f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:42.895770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 235/477] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:42.922049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba46a2-63df-40f9-b971-caac4845138a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:42.986141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:43.044207 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba46a2-63df-40f9-b971-caac4845138a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:43.080608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57a330-40f7-44c0-981c-e386de5bc653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:43.081355 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a330-40f7-44c0-981c-e386de5bc653 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.081642 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a330-40f7-44c0-981c-e386de5bc653 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.081925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57a330-40f7-44c0-981c-e386de5bc653 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.092849 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57a330-40f7-44c0-981c-e386de5bc653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-da57a330-40f7-44c0-981c-e386de5bc653 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:43.101180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:43.102110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:43.102900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 243/478] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:43.108210 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeae8ef-a741-418e-95fc-3deba87547f5 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:43.164819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc4a6-bfbb-4b97-be58-b09763bb45a1 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.164819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc4a6-bfbb-4b97-be58-b09763bb45a1 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.164819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcc4a6-bfbb-4b97-be58-b09763bb45a1 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.164819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 244/479] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:42:43.170517 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344c3d-6e25-4be5-a606-1fbd76bf500a None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.171031 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344c3d-6e25-4be5-a606-1fbd76bf500a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.171572 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344c3d-6e25-4be5-a606-1fbd76bf500a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.188172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:43.192503 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-c7344c3d-6e25-4be5-a606-1fbd76bf500a None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:43.193947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-c7344c3d-6e25-4be5-a606-1fbd76bf500a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:43.230791 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeae8ef-a741-418e-95fc-3deba87547f5 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:43.274038 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407fdb5-d78b-40f6-ab07-8358327ff637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:43.281649 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 245/480] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:43.282615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407fdb5-d78b-40f6-ab07-8358327ff637 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.283051 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407fdb5-d78b-40f6-ab07-8358327ff637 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.283472 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407fdb5-d78b-40f6-ab07-8358327ff637 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.284437 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407fdb5-d78b-40f6-ab07-8358327ff637 None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:43.284902 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407fdb5-d78b-40f6-ab07-8358327ff637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:43.286510 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407fdb5-d78b-40f6-ab07-8358327ff637 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:43.310298 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 236/481] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:43.317807 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7344c3d-6e25-4be5-a606-1fbd76bf500a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:43.337054 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407fdb5-d78b-40f6-ab07-8358327ff637 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:43.397913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:43.513537 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407fdb5-d78b-40f6-ab07-8358327ff637 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:43.548680 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7344c3d-6e25-4be5-a606-1fbd76bf500a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:43.566051 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00e01c-f117-4664-88e1-e164a4a341b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:43.567196 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00e01c-f117-4664-88e1-e164a4a341b1 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.567679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00e01c-f117-4664-88e1-e164a4a341b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.568175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00e01c-f117-4664-88e1-e164a4a341b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.579673 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:43.594639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00e01c-f117-4664-88e1-e164a4a341b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:43.604497 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729ef87-eb62-457b-972c-07d74f222880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-fb00e01c-f117-4664-88e1-e164a4a341b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:43.604641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:43.605521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:43.606356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:43.606976 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729ef87-eb62-457b-972c-07d74f222880 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.606976 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729ef87-eb62-457b-972c-07d74f222880 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.606976 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729ef87-eb62-457b-972c-07d74f222880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.611101 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 237/482] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:43.611101 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7f306-25ad-4e76-9744-4125b9b6e879 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.611396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7f306-25ad-4e76-9744-4125b9b6e879 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.611471 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7f306-25ad-4e76-9744-4125b9b6e879 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.612998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 238/483] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:43.613614 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7f306-25ad-4e76-9744-4125b9b6e879 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:43.623508 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729ef87-eb62-457b-972c-07d74f222880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:43.625564 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729ef87-eb62-457b-972c-07d74f222880 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-f729ef87-eb62-457b-972c-07d74f222880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:43.647947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:43.648854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:43.649751 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:43.649751 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:43.649751 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:43.649751 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:43.653870 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 246/484] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:43.655183 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c63de8-3d07-448d-94ff-60dcdc19e4ae None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.655478 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c63de8-3d07-448d-94ff-60dcdc19e4ae None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.656031 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c63de8-3d07-448d-94ff-60dcdc19e4ae None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.657593 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 247/485] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:43.658896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac32eb-cf6b-42c9-a236-4764284ab9fb None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.659186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac32eb-cf6b-42c9-a236-4764284ab9fb None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.659525 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ac32eb-cf6b-42c9-a236-4764284ab9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.676427 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-67ac32eb-cf6b-42c9-a236-4764284ab9fb None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:43.677673 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-67ac32eb-cf6b-42c9-a236-4764284ab9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:43.735053 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7f306-25ad-4e76-9744-4125b9b6e879 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:43.752677 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 248/486] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:43.753744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac32eb-cf6b-42c9-a236-4764284ab9fb None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:43.768926 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c68910-dd6d-4daa-988f-5820c78b84e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:43.769618 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c68910-dd6d-4daa-988f-5820c78b84e0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.769901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c68910-dd6d-4daa-988f-5820c78b84e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.770175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c68910-dd6d-4daa-988f-5820c78b84e0 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.770913 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c68910-dd6d-4daa-988f-5820c78b84e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:43.771219 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c68910-dd6d-4daa-988f-5820c78b84e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:43.772591 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c68910-dd6d-4daa-988f-5820c78b84e0 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:43.778217 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:43.781394 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 239/487] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:43.782735 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f7df3-472f-4fa7-95e3-3769ca90f41d None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.783027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f7df3-472f-4fa7-95e3-3769ca90f41d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.783307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f7df3-472f-4fa7-95e3-3769ca90f41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.799653 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-ad5f7df3-472f-4fa7-95e3-3769ca90f41d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:43.800837 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-ad5f7df3-472f-4fa7-95e3-3769ca90f41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:43.849232 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:43.852436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ac32eb-cf6b-42c9-a236-4764284ab9fb None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:43.867223 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 240/488] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:43.867883 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f7df3-472f-4fa7-95e3-3769ca90f41d None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:43.894626 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff4ebc-3f57-43bc-83d8-83f8b66c22b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:43.895291 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff4ebc-3f57-43bc-83d8-83f8b66c22b3 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:43.895573 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff4ebc-3f57-43bc-83d8-83f8b66c22b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:43.895851 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff4ebc-3f57-43bc-83d8-83f8b66c22b3 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:43.896571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff4ebc-3f57-43bc-83d8-83f8b66c22b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:43.896877 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff4ebc-3f57-43bc-83d8-83f8b66c22b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:43.898270 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff4ebc-3f57-43bc-83d8-83f8b66c22b3 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:43.909687 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 249/489] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:43.910707 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff4ebc-3f57-43bc-83d8-83f8b66c22b3 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:43.970222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f7df3-472f-4fa7-95e3-3769ca90f41d None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:43.990932 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:44.003751 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b728b0-406e-4e3f-bb76-310584c54764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.004539 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b728b0-406e-4e3f-bb76-310584c54764 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.004820 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b728b0-406e-4e3f-bb76-310584c54764 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.005093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b728b0-406e-4e3f-bb76-310584c54764 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.009490 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff4ebc-3f57-43bc-83d8-83f8b66c22b3 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.015250 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b728b0-406e-4e3f-bb76-310584c54764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-55b728b0-406e-4e3f-bb76-310584c54764 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:44.027924 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:44.028845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:44.029683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 241/490] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:44.030336 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b728b0-406e-4e3f-bb76-310584c54764 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.045603 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e891c92-a393-43a7-9fb5-4151c9e6ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.046394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e891c92-a393-43a7-9fb5-4151c9e6ce1a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.047267 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e891c92-a393-43a7-9fb5-4151c9e6ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.047644 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e891c92-a393-43a7-9fb5-4151c9e6ce1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.058995 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e891c92-a393-43a7-9fb5-4151c9e6ce1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.060436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e891c92-a393-43a7-9fb5-4151c9e6ce1a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.076299 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-9e891c92-a393-43a7-9fb5-4151c9e6ce1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:44.076983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:44.078784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:44.079665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:44.079665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:44.079665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:44.079665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:44.079665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 250/491] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:44.079665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e891c92-a393-43a7-9fb5-4151c9e6ce1a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.132970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b728b0-406e-4e3f-bb76-310584c54764 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.167958 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24874691-c68b-4b9a-9b92-97d6b8c3a0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.168991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24874691-c68b-4b9a-9b92-97d6b8c3a0b0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.169270 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24874691-c68b-4b9a-9b92-97d6b8c3a0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.169568 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24874691-c68b-4b9a-9b92-97d6b8c3a0b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.182259 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24874691-c68b-4b9a-9b92-97d6b8c3a0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:44.185338 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e891c92-a393-43a7-9fb5-4151c9e6ce1a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-24874691-c68b-4b9a-9b92-97d6b8c3a0b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:44.189979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:44.190999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:44.191843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 242/492] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:44.192502 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24874691-c68b-4b9a-9b92-97d6b8c3a0b0 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.220050 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fdd29-240b-430e-9cc9-80b9ad720dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.220835 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fdd29-240b-430e-9cc9-80b9ad720dc8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.221119 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fdd29-240b-430e-9cc9-80b9ad720dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.221425 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fdd29-240b-430e-9cc9-80b9ad720dc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.223330 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:44.230592 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301fdd29-240b-430e-9cc9-80b9ad720dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.232012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301fdd29-240b-430e-9cc9-80b9ad720dc8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-301fdd29-240b-430e-9cc9-80b9ad720dc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:44.247691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:44.248757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:44.249672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 251/493] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:44.250267 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fdd29-240b-430e-9cc9-80b9ad720dc8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.293161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24874691-c68b-4b9a-9b92-97d6b8c3a0b0 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.300480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:44.327243 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc7d60-2240-4263-9f6f-5e356d1cf709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.328035 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc7d60-2240-4263-9f6f-5e356d1cf709 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.328380 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc7d60-2240-4263-9f6f-5e356d1cf709 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.328660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc7d60-2240-4263-9f6f-5e356d1cf709 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.329489 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc7d60-2240-4263-9f6f-5e356d1cf709 None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:44.329802 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc7d60-2240-4263-9f6f-5e356d1cf709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.331208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc7d60-2240-4263-9f6f-5e356d1cf709 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.339087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 243/494] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:44.339859 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc7d60-2240-4263-9f6f-5e356d1cf709 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.349768 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fdd29-240b-430e-9cc9-80b9ad720dc8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.383854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72642f-3318-4db6-ba56-9a6dfc8abcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.384426 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72642f-3318-4db6-ba56-9a6dfc8abcff None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.384707 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72642f-3318-4db6-ba56-9a6dfc8abcff None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.384980 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72642f-3318-4db6-ba56-9a6dfc8abcff None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.385729 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72642f-3318-4db6-ba56-9a6dfc8abcff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:44.386032 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72642f-3318-4db6-ba56-9a6dfc8abcff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.387401 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb72642f-3318-4db6-ba56-9a6dfc8abcff None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.398817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 252/495] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:44.399595 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72642f-3318-4db6-ba56-9a6dfc8abcff None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.439989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc7d60-2240-4263-9f6f-5e356d1cf709 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.453924 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:44.473631 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046171-ad88-4c70-8972-f30444e2dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.474291 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046171-ad88-4c70-8972-f30444e2dae9 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.474572 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046171-ad88-4c70-8972-f30444e2dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.474843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046171-ad88-4c70-8972-f30444e2dae9 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.475574 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046171-ad88-4c70-8972-f30444e2dae9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:44.475876 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046171-ad88-4c70-8972-f30444e2dae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.477239 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046171-ad88-4c70-8972-f30444e2dae9 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.485085 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 244/496] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:44.485900 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046171-ad88-4c70-8972-f30444e2dae9 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.500569 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72642f-3318-4db6-ba56-9a6dfc8abcff None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.515757 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:44.535302 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f789c-fcd1-49c2-9642-89b500fd45e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.535959 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f789c-fcd1-49c2-9642-89b500fd45e9 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.536236 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f789c-fcd1-49c2-9642-89b500fd45e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.536508 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f789c-fcd1-49c2-9642-89b500fd45e9 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.537346 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f789c-fcd1-49c2-9642-89b500fd45e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:44.537651 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f789c-fcd1-49c2-9642-89b500fd45e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.539054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f789c-fcd1-49c2-9642-89b500fd45e9 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.574275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 253/497] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:44.575086 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f789c-fcd1-49c2-9642-89b500fd45e9 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.588714 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046171-ad88-4c70-8972-f30444e2dae9 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.621733 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200fbb-24ed-404f-8d93-b15bb4cc12ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.622511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200fbb-24ed-404f-8d93-b15bb4cc12ed None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.622789 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200fbb-24ed-404f-8d93-b15bb4cc12ed None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.623059 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a200fbb-24ed-404f-8d93-b15bb4cc12ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.633399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a200fbb-24ed-404f-8d93-b15bb4cc12ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.634878 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a200fbb-24ed-404f-8d93-b15bb4cc12ed None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-6a200fbb-24ed-404f-8d93-b15bb4cc12ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:44.651847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:44.652798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:44.653740 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:44.653740 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:44.653740 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:44.653740 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:44.653740 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 245/498] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:44.654013 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200fbb-24ed-404f-8d93-b15bb4cc12ed None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.675777 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f789c-fcd1-49c2-9642-89b500fd45e9 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.689751 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:44.710651 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bf0f5-2be0-4f2a-aa78-de5128a08a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.711431 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bf0f5-2be0-4f2a-aa78-de5128a08a12 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.711711 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bf0f5-2be0-4f2a-aa78-de5128a08a12 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.711987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9bf0f5-2be0-4f2a-aa78-de5128a08a12 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.719407 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bf0f5-2be0-4f2a-aa78-de5128a08a12 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.720832 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9bf0f5-2be0-4f2a-aa78-de5128a08a12 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-bb9bf0f5-2be0-4f2a-aa78-de5128a08a12 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:44.734944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:44.735840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:44.736726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 254/499] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:44.737272 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bf0f5-2be0-4f2a-aa78-de5128a08a12 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.738669 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:44.758220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a200fbb-24ed-404f-8d93-b15bb4cc12ed None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.792016 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788aa09-867b-4bd7-b9c8-f239eb83a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.792789 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788aa09-867b-4bd7-b9c8-f239eb83a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.793067 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788aa09-867b-4bd7-b9c8-f239eb83a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.793366 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788aa09-867b-4bd7-b9c8-f239eb83a3f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.803706 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788aa09-867b-4bd7-b9c8-f239eb83a3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.805142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788aa09-867b-4bd7-b9c8-f239eb83a3f5 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-a788aa09-867b-4bd7-b9c8-f239eb83a3f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:44.822315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:44.823150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:44.823974 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:44.823974 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:44.823974 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:44.823974 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:44.823974 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 246/500] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:44.824239 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788aa09-867b-4bd7-b9c8-f239eb83a3f5 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:44.838022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9bf0f5-2be0-4f2a-aa78-de5128a08a12 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.873405 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d606b6-0b3b-42a7-ab94-9a60532b050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.874093 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d606b6-0b3b-42a7-ab94-9a60532b050d None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.874310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d606b6-0b3b-42a7-ab94-9a60532b050d None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.875088 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d606b6-0b3b-42a7-ab94-9a60532b050d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.915656 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:44.926230 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788aa09-867b-4bd7-b9c8-f239eb83a3f5 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:44.942255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d606b6-0b3b-42a7-ab94-9a60532b050d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.943698 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d606b6-0b3b-42a7-ab94-9a60532b050d None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.959011 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e735-a902-4239-b5a9-02b955d034a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:44.959661 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e735-a902-4239-b5a9-02b955d034a8 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:44.959940 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e735-a902-4239-b5a9-02b955d034a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:44.960214 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5e735-a902-4239-b5a9-02b955d034a8 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:44.960933 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e735-a902-4239-b5a9-02b955d034a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:44.961402 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e735-a902-4239-b5a9-02b955d034a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:44.962763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f5e735-a902-4239-b5a9-02b955d034a8 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:44.964131 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:44.974925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 247/501] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:44.975699 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e735-a902-4239-b5a9-02b955d034a8 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.043968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 255/502] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:45.044801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d606b6-0b3b-42a7-ab94-9a60532b050d None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.073206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5e735-a902-4239-b5a9-02b955d034a8 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.107887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cba6f-4604-42a4-9110-ee7e78b313fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.108534 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cba6f-4604-42a4-9110-ee7e78b313fa None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.108812 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cba6f-4604-42a4-9110-ee7e78b313fa None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.109087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37cba6f-4604-42a4-9110-ee7e78b313fa None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.109933 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cba6f-4604-42a4-9110-ee7e78b313fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:45.110229 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cba6f-4604-42a4-9110-ee7e78b313fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:45.111697 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37cba6f-4604-42a4-9110-ee7e78b313fa None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:45.116755 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:45.146426 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d606b6-0b3b-42a7-ab94-9a60532b050d None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.147711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 248/503] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Jul 12 18:42:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:45.148536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cba6f-4604-42a4-9110-ee7e78b313fa None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.183254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645488c-029b-430d-911a-74e36ac58fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.183840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645488c-029b-430d-911a-74e36ac58fa6 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.184124 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645488c-029b-430d-911a-74e36ac58fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.184404 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645488c-029b-430d-911a-74e36ac58fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.185122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645488c-029b-430d-911a-74e36ac58fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:45.185469 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645488c-029b-430d-911a-74e36ac58fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:45.186844 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7645488c-029b-430d-911a-74e36ac58fa6 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:45.198923 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 256/504] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:45.199746 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645488c-029b-430d-911a-74e36ac58fa6 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.207419 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:45.254961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37cba6f-4604-42a4-9110-ee7e78b313fa None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.287937 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1759-7c90-4d70-abc3-fd60d582a53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.288720 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1759-7c90-4d70-abc3-fd60d582a53c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.289000 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1759-7c90-4d70-abc3-fd60d582a53c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.289269 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c1759-7c90-4d70-abc3-fd60d582a53c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.296062 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c1759-7c90-4d70-abc3-fd60d582a53c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:45.298065 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0c1759-7c90-4d70-abc3-fd60d582a53c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:45.298219 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645488c-029b-430d-911a-74e36ac58fa6 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-de0c1759-7c90-4d70-abc3-fd60d582a53c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:45.314105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:45.315042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 249/505] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:45.316129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1759-7c90-4d70-abc3-fd60d582a53c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.329157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:45.334825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d84be-9813-4f49-aff7-ff36fbedef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.335613 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d84be-9813-4f49-aff7-ff36fbedef78 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.335896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d84be-9813-4f49-aff7-ff36fbedef78 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.336173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d84be-9813-4f49-aff7-ff36fbedef78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.346986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d84be-9813-4f49-aff7-ff36fbedef78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:45.348422 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d84be-9813-4f49-aff7-ff36fbedef78 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-7f3d84be-9813-4f49-aff7-ff36fbedef78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:45.367287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:45.368232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:45.369105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:45.369105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:45.369105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:45.369105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:45.369105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 257/506] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:45.369409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d84be-9813-4f49-aff7-ff36fbedef78 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.418999 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c1759-7c90-4d70-abc3-fd60d582a53c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.431749 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:45.452555 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b787bb-ebc7-47c8-88cd-4fe760fdc4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.453155 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b787bb-ebc7-47c8-88cd-4fe760fdc4e1 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.453475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b787bb-ebc7-47c8-88cd-4fe760fdc4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.453755 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b787bb-ebc7-47c8-88cd-4fe760fdc4e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.466078 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d84be-9813-4f49-aff7-ff36fbedef78 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.498982 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bb38f-4568-43b3-b736-ad68ba729e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.500300 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bb38f-4568-43b3-b736-ad68ba729e2b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.500583 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bb38f-4568-43b3-b736-ad68ba729e2b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.500859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bb38f-4568-43b3-b736-ad68ba729e2b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.508080 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bb38f-4568-43b3-b736-ad68ba729e2b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:45.509552 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bb38f-4568-43b3-b736-ad68ba729e2b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:45.519456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b787bb-ebc7-47c8-88cd-4fe760fdc4e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:45.520909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b787bb-ebc7-47c8-88cd-4fe760fdc4e1 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-673bb38f-4568-43b3-b736-ad68ba729e2b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:45.523432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:45.524410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:45.525316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 258/507] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:45.526201 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bb38f-4568-43b3-b736-ad68ba729e2b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.570522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:45.618545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 250/508] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:45.619376 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b787bb-ebc7-47c8-88cd-4fe760fdc4e1 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.625798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bb38f-4568-43b3-b736-ad68ba729e2b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.633254 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:45.659542 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6855b-0b31-44b3-96d9-2ecac7f0cbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.660204 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6855b-0b31-44b3-96d9-2ecac7f0cbc1 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.660494 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6855b-0b31-44b3-96d9-2ecac7f0cbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.660771 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6855b-0b31-44b3-96d9-2ecac7f0cbc1 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.661630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6855b-0b31-44b3-96d9-2ecac7f0cbc1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:45.661967 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6855b-0b31-44b3-96d9-2ecac7f0cbc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:45.663388 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6855b-0b31-44b3-96d9-2ecac7f0cbc1 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:45.680735 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 259/509] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:45.681545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6855b-0b31-44b3-96d9-2ecac7f0cbc1 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.716206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b787bb-ebc7-47c8-88cd-4fe760fdc4e1 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.750432 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56987e73-182a-4bab-8552-e43e8ba99555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.751084 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56987e73-182a-4bab-8552-e43e8ba99555 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.751364 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56987e73-182a-4bab-8552-e43e8ba99555 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.751634 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56987e73-182a-4bab-8552-e43e8ba99555 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.752340 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56987e73-182a-4bab-8552-e43e8ba99555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:45.752643 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56987e73-182a-4bab-8552-e43e8ba99555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:45.754035 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56987e73-182a-4bab-8552-e43e8ba99555 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:45.764884 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 251/510] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:45.765809 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56987e73-182a-4bab-8552-e43e8ba99555 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.781638 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6855b-0b31-44b3-96d9-2ecac7f0cbc1 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.783915 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:45.815833 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e16dc5-2e85-4925-ba3f-1e7904d65033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.816493 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e16dc5-2e85-4925-ba3f-1e7904d65033 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.816774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e16dc5-2e85-4925-ba3f-1e7904d65033 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.817049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e16dc5-2e85-4925-ba3f-1e7904d65033 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.817894 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e16dc5-2e85-4925-ba3f-1e7904d65033 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:45.818297 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e16dc5-2e85-4925-ba3f-1e7904d65033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:45.819717 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e16dc5-2e85-4925-ba3f-1e7904d65033 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:45.836158 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 260/511] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:45.836935 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e16dc5-2e85-4925-ba3f-1e7904d65033 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.841939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:45.874667 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56987e73-182a-4bab-8552-e43e8ba99555 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.908141 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e4b3c-b0f0-45b7-a612-c11e31083308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.909135 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e4b3c-b0f0-45b7-a612-c11e31083308 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.909666 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e4b3c-b0f0-45b7-a612-c11e31083308 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.910137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e4b3c-b0f0-45b7-a612-c11e31083308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.923099 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e4b3c-b0f0-45b7-a612-c11e31083308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:45.924565 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e4b3c-b0f0-45b7-a612-c11e31083308 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:45.936644 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e16dc5-2e85-4925-ba3f-1e7904d65033 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-3c3e4b3c-b0f0-45b7-a612-c11e31083308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:45.941483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:45.942683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:45.943536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:45.943536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:45.943536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:45.943536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:45.943536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 252/512] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:45.943536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e4b3c-b0f0-45b7-a612-c11e31083308 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:45.971103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ef7e8-e766-4e0d-b3ab-281e04678eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:45.971686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ef7e8-e766-4e0d-b3ab-281e04678eca None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:45.971975 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ef7e8-e766-4e0d-b3ab-281e04678eca None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:45.972253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ef7e8-e766-4e0d-b3ab-281e04678eca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:45.998632 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:46.038492 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ef7e8-e766-4e0d-b3ab-281e04678eca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.039924 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ef7e8-e766-4e0d-b3ab-281e04678eca None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.042846 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e4b3c-b0f0-45b7-a612-c11e31083308 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:46.064892 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:46.075797 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a3d64-eae3-48ba-b22b-094e189d2536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:46.076581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a3d64-eae3-48ba-b22b-094e189d2536 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:46.076866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a3d64-eae3-48ba-b22b-094e189d2536 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:46.077139 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a3d64-eae3-48ba-b22b-094e189d2536 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:46.084235 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a3d64-eae3-48ba-b22b-094e189d2536 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.085717 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a3d64-eae3-48ba-b22b-094e189d2536 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-d34a3d64-eae3-48ba-b22b-094e189d2536 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:46.100908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:46.101798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:46.102636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:46.102636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:46.102636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:46.102636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:46.102636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:46.102636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:46.102636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:46.102636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:46.102636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 253/513] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:46.103105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a3d64-eae3-48ba-b22b-094e189d2536 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.139163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 261/514] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:46.139163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ef7e8-e766-4e0d-b3ab-281e04678eca None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.200486 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:46.216687 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a3d64-eae3-48ba-b22b-094e189d2536 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:46.241833 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ef7e8-e766-4e0d-b3ab-281e04678eca None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:46.249621 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1d855-ef1e-494c-a382-e6e2ed33322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:46.250260 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d855-ef1e-494c-a382-e6e2ed33322f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:46.250541 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d855-ef1e-494c-a382-e6e2ed33322f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:46.250824 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1d855-ef1e-494c-a382-e6e2ed33322f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:46.274987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d8aaf-86a2-4931-87d6-af1e0409728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:46.275642 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d8aaf-86a2-4931-87d6-af1e0409728a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:46.275927 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d8aaf-86a2-4931-87d6-af1e0409728a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:46.276207 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d8aaf-86a2-4931-87d6-af1e0409728a None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:46.276917 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d8aaf-86a2-4931-87d6-af1e0409728a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:46.277232 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d8aaf-86a2-4931-87d6-af1e0409728a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.278643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d8aaf-86a2-4931-87d6-af1e0409728a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.290331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 262/515] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:46.291118 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d8aaf-86a2-4931-87d6-af1e0409728a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.305892 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:46.322425 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1d855-ef1e-494c-a382-e6e2ed33322f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.323882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1d855-ef1e-494c-a382-e6e2ed33322f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.387468 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d8aaf-86a2-4931-87d6-af1e0409728a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:46.407610 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:46.419542 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 254/516] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:46.420368 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1d855-ef1e-494c-a382-e6e2ed33322f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.425774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9175a-24c6-4286-b04d-0d0135f9027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:46.426423 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9175a-24c6-4286-b04d-0d0135f9027c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:46.426702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9175a-24c6-4286-b04d-0d0135f9027c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:46.426975 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9175a-24c6-4286-b04d-0d0135f9027c None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:46.427739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9175a-24c6-4286-b04d-0d0135f9027c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:46.428050 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9175a-24c6-4286-b04d-0d0135f9027c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.429495 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9175a-24c6-4286-b04d-0d0135f9027c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.447389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 263/517] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:46.448183 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9175a-24c6-4286-b04d-0d0135f9027c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.503181 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:46.519968 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1d855-ef1e-494c-a382-e6e2ed33322f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:46.547957 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9175a-24c6-4286-b04d-0d0135f9027c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:46.552546 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530318a-1a64-450b-a147-ccb72ae2de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:46.553358 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530318a-1a64-450b-a147-ccb72ae2de3d None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:46.553644 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530318a-1a64-450b-a147-ccb72ae2de3d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:46.553922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530318a-1a64-450b-a147-ccb72ae2de3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:46.564319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530318a-1a64-450b-a147-ccb72ae2de3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.565987 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530318a-1a64-450b-a147-ccb72ae2de3d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.581557 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0ea1b-ffea-4a9f-acf5-ce92c0a88a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:46.582335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ea1b-ffea-4a9f-acf5-ce92c0a88a56 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:46.582621 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ea1b-ffea-4a9f-acf5-ce92c0a88a56 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:46.582898 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c0ea1b-ffea-4a9f-acf5-ce92c0a88a56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-5530318a-1a64-450b-a147-ccb72ae2de3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:46.583828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:46.584711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:46.585598 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:46.585598 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:46.585598 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:46.585598 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:46.585598 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 255/518] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:46.585863 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530318a-1a64-450b-a147-ccb72ae2de3d None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.593073 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0ea1b-ffea-4a9f-acf5-ce92c0a88a56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.594665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c0ea1b-ffea-4a9f-acf5-ce92c0a88a56 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-a9c0ea1b-ffea-4a9f-acf5-ce92c0a88a56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:46.608884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:46.609779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:46.610641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:46.610641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:46.610641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:46.610641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:46.610641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:46.610641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:46.610641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:46.610641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:46.610641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 264/519] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:46.611110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0ea1b-ffea-4a9f-acf5-ce92c0a88a56 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.652200 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:46.686457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530318a-1a64-450b-a147-ccb72ae2de3d None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:46.708749 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c0ea1b-ffea-4a9f-acf5-ce92c0a88a56 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:46.719080 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876398f-4366-4f0e-8cc4-9b48d1ecef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:46.719890 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876398f-4366-4f0e-8cc4-9b48d1ecef59 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:46.720171 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876398f-4366-4f0e-8cc4-9b48d1ecef59 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:46.720447 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876398f-4366-4f0e-8cc4-9b48d1ecef59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:46.723140 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:46.730938 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876398f-4366-4f0e-8cc4-9b48d1ecef59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.732370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876398f-4366-4f0e-8cc4-9b48d1ecef59 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.744994 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a42b5f-9b81-4523-8afc-17f090ef47a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:46.745673 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a42b5f-9b81-4523-8afc-17f090ef47a3 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:46.745957 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a42b5f-9b81-4523-8afc-17f090ef47a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:46.746233 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a42b5f-9b81-4523-8afc-17f090ef47a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:46.747049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a42b5f-9b81-4523-8afc-17f090ef47a3 None admin] RBAC: Adding query filter params (role.id=5d30b117c7cb45a6ae69d3f19986213d, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=72918f9adc4240d99640b419e013b343) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:46.747359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a42b5f-9b81-4523-8afc-17f090ef47a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.748778 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a42b5f-9b81-4523-8afc-17f090ef47a3 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-a876398f-4366-4f0e-8cc4-9b48d1ecef59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:46.750679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:46.751624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:46.752657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:46.752657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:46.752657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:46.752657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:46.752657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 256/520] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:46.752657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876398f-4366-4f0e-8cc4-9b48d1ecef59 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.769370 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 265/521] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/role_assignments?user.id=72918f9adc4240d99640b419e013b343&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=5d30b117c7cb45a6ae69d3f19986213d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:46.769370 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a42b5f-9b81-4523-8afc-17f090ef47a3 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.873460 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876398f-4366-4f0e-8cc4-9b48d1ecef59 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:46.900045 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a42b5f-9b81-4523-8afc-17f090ef47a3 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:46.903787 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:46.913115 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c26fd4-f278-4dbd-8eba-558bec98c8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:46.913825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c26fd4-f278-4dbd-8eba-558bec98c8a2 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:46.914110 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c26fd4-f278-4dbd-8eba-558bec98c8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:46.914538 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c26fd4-f278-4dbd-8eba-558bec98c8a2 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:46.915112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c26fd4-f278-4dbd-8eba-558bec98c8a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:46.915418 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c26fd4-f278-4dbd-8eba-558bec98c8a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.916802 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c26fd4-f278-4dbd-8eba-558bec98c8a2 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.931212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 257/522] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:46.936560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c26fd4-f278-4dbd-8eba-558bec98c8a2 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.947549 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275079e9-beb8-4d7e-9c8b-83d663669a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:46.948359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275079e9-beb8-4d7e-9c8b-83d663669a61 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:46.948474 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275079e9-beb8-4d7e-9c8b-83d663669a61 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:46.948745 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275079e9-beb8-4d7e-9c8b-83d663669a61 None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:46.949560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275079e9-beb8-4d7e-9c8b-83d663669a61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:46.949873 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275079e9-beb8-4d7e-9c8b-83d663669a61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:46.951298 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275079e9-beb8-4d7e-9c8b-83d663669a61 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:46.967969 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 266/523] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:46.967969 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275079e9-beb8-4d7e-9c8b-83d663669a61 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:46.994114 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:47.051119 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c26fd4-f278-4dbd-8eba-558bec98c8a2 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:47.079159 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275079e9-beb8-4d7e-9c8b-83d663669a61 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:47.087021 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcdf9b-1074-4e8f-b3df-1c934905adbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:47.087687 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcdf9b-1074-4e8f-b3df-1c934905adbb None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:47.087972 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcdf9b-1074-4e8f-b3df-1c934905adbb None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:47.088246 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcdf9b-1074-4e8f-b3df-1c934905adbb None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:47.088965 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcdf9b-1074-4e8f-b3df-1c934905adbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:47.089270 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcdf9b-1074-4e8f-b3df-1c934905adbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:47.090675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcdf9b-1074-4e8f-b3df-1c934905adbb None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:47.102767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 258/524] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:47.103548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcdf9b-1074-4e8f-b3df-1c934905adbb None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:47.122533 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b46f-4418-4a3f-ae54-838219ec34c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:47.123670 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b46f-4418-4a3f-ae54-838219ec34c8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:47.124019 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b46f-4418-4a3f-ae54-838219ec34c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:47.124365 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021b46f-4418-4a3f-ae54-838219ec34c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:47.132145 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021b46f-4418-4a3f-ae54-838219ec34c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:47.133716 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021b46f-4418-4a3f-ae54-838219ec34c8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-9021b46f-4418-4a3f-ae54-838219ec34c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:47.148409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:47.149602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:47.150684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:47.150684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:47.150684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:47.150684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:47.150684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:47.150684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:47.150684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:47.150684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:47.151738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 267/525] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:47.152191 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b46f-4418-4a3f-ae54-838219ec34c8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:47.180459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:47.226498 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcdf9b-1074-4e8f-b3df-1c934905adbb None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:47.238529 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:47.262159 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021b46f-4418-4a3f-ae54-838219ec34c8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:47.267551 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271473e-db15-41b8-8d75-15056f0e3621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:47.268205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271473e-db15-41b8-8d75-15056f0e3621 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:47.268486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271473e-db15-41b8-8d75-15056f0e3621 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:47.268760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271473e-db15-41b8-8d75-15056f0e3621 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:47.269614 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271473e-db15-41b8-8d75-15056f0e3621 None admin] RBAC: Adding query filter params (role.id=5d30b117c7cb45a6ae69d3f19986213d, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=86c0b548be2d4948bca2817337fdee5f) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:47.269926 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271473e-db15-41b8-8d75-15056f0e3621 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:47.271359 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271473e-db15-41b8-8d75-15056f0e3621 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:47.284145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 259/526] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:47 2022] GET /identity/v3/role_assignments?user.id=86c0b548be2d4948bca2817337fdee5f&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=5d30b117c7cb45a6ae69d3f19986213d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:47.284145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271473e-db15-41b8-8d75-15056f0e3621 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:47.310481 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00344934-b03f-4f91-be68-bbe942f77be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:47.311301 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00344934-b03f-4f91-be68-bbe942f77be7 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:47.311769 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00344934-b03f-4f91-be68-bbe942f77be7 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:47.312660 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00344934-b03f-4f91-be68-bbe942f77be7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:47.321254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00344934-b03f-4f91-be68-bbe942f77be7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:47.322968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00344934-b03f-4f91-be68-bbe942f77be7 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-00344934-b03f-4f91-be68-bbe942f77be7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:47.339137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:47.340331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:47.341239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:47.341239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:47.341239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:47.341239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:47.341239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:47.341239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:47.341239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:47.341239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:47.341239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 268/527] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:47.346547 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00344934-b03f-4f91-be68-bbe942f77be7 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:47.422868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271473e-db15-41b8-8d75-15056f0e3621 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:47.445067 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:47.463254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00344934-b03f-4f91-be68-bbe942f77be7 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:47.478097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d7866-c4cc-472e-ae9c-26bf75a9cbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:47.479336 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d7866-c4cc-472e-ae9c-26bf75a9cbdd None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:47.479624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d7866-c4cc-472e-ae9c-26bf75a9cbdd None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:47.479959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d7866-c4cc-472e-ae9c-26bf75a9cbdd None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:47.481942 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d7866-c4cc-472e-ae9c-26bf75a9cbdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:47.481942 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d7866-c4cc-472e-ae9c-26bf75a9cbdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:47.484536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d7866-c4cc-472e-ae9c-26bf75a9cbdd None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:47.506371 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7fa9c-b57b-4f80-b898-2c58b4d59fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:47.507370 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7fa9c-b57b-4f80-b898-2c58b4d59fde None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:47.507806 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7fa9c-b57b-4f80-b898-2c58b4d59fde None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:47.508213 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7fa9c-b57b-4f80-b898-2c58b4d59fde None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:47.509106 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7fa9c-b57b-4f80-b898-2c58b4d59fde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:47.509596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7fa9c-b57b-4f80-b898-2c58b4d59fde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:47.510595 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 260/528] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:47.511393 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7fa9c-b57b-4f80-b898-2c58b4d59fde None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:47.511510 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d7866-c4cc-472e-ae9c-26bf75a9cbdd None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:47.530329 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 269/529] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:47.532172 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7fa9c-b57b-4f80-b898-2c58b4d59fde None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:47.544570 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:47.620667 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d7866-c4cc-472e-ae9c-26bf75a9cbdd None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:47.637883 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7fa9c-b57b-4f80-b898-2c58b4d59fde None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:47.658506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0adbe-1340-41a8-a83f-03a50b2a91bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:47.659465 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0adbe-1340-41a8-a83f-03a50b2a91bc None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:47.659904 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0adbe-1340-41a8-a83f-03a50b2a91bc None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:47.660180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0adbe-1340-41a8-a83f-03a50b2a91bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:47.661000 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0adbe-1340-41a8-a83f-03a50b2a91bc None admin] RBAC: Adding query filter params (role.id=5d30b117c7cb45a6ae69d3f19986213d, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=a60cee165d0f46ef8078a91f03788410) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:47.661332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0adbe-1340-41a8-a83f-03a50b2a91bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:47.662764 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0adbe-1340-41a8-a83f-03a50b2a91bc None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:47.669317 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 261/530] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:47 2022] GET /identity/v3/role_assignments?user.id=a60cee165d0f46ef8078a91f03788410&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=5d30b117c7cb45a6ae69d3f19986213d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:47.689243 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d522b53-c872-436f-9ef3-d5b2d538f4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:47.689998 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d522b53-c872-436f-9ef3-d5b2d538f4a4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:47.690284 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d522b53-c872-436f-9ef3-d5b2d538f4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:47.690617 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d522b53-c872-436f-9ef3-d5b2d538f4a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:47.691462 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d522b53-c872-436f-9ef3-d5b2d538f4a4 None admin] RBAC: Adding query filter params (role.id=5d30b117c7cb45a6ae69d3f19986213d, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=b296e5ba36b243009b5fcfe708506c00) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:47.691775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d522b53-c872-436f-9ef3-d5b2d538f4a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:47.694201 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d522b53-c872-436f-9ef3-d5b2d538f4a4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:47.703676 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 270/531] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:47 2022] GET /identity/v3/role_assignments?user.id=b296e5ba36b243009b5fcfe708506c00&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=5d30b117c7cb45a6ae69d3f19986213d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:48.978898 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e938d9-3632-4dfa-9573-324aa481e23d None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:48.979445 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e938d9-3632-4dfa-9573-324aa481e23d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:48.979445 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e938d9-3632-4dfa-9573-324aa481e23d None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:48.981024 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 262/532] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:48.986383 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7f18-1024-4d24-8a56-0b17ef609142 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:48.986771 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7f18-1024-4d24-8a56-0b17ef609142 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:48.986949 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e7f18-1024-4d24-8a56-0b17ef609142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:49.003798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-710e7f18-1024-4d24-8a56-0b17ef609142 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:49.005046 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-710e7f18-1024-4d24-8a56-0b17ef609142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:49.007036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:49.074970 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 271/533] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:49.098770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e938d9-3632-4dfa-9573-324aa481e23d None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:49.199264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:49.207612 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e938d9-3632-4dfa-9573-324aa481e23d None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:49.245074 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08e875-7f92-4e28-8ae3-430964a411d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:49.246241 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08e875-7f92-4e28-8ae3-430964a411d0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:49.246716 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08e875-7f92-4e28-8ae3-430964a411d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:49.247129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08e875-7f92-4e28-8ae3-430964a411d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:49.259849 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08e875-7f92-4e28-8ae3-430964a411d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-ee08e875-7f92-4e28-8ae3-430964a411d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:49.269558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:49.270627 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:49.271617 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:49.273854 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 263/534] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:49.279395 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e7f18-1024-4d24-8a56-0b17ef609142 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:49.379592 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e7f18-1024-4d24-8a56-0b17ef609142 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:49.415210 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875e281-1e3b-4413-99aa-a8254cf5804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:49.415883 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875e281-1e3b-4413-99aa-a8254cf5804c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:49.416167 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875e281-1e3b-4413-99aa-a8254cf5804c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:49.416442 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875e281-1e3b-4413-99aa-a8254cf5804c None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:49.417187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875e281-1e3b-4413-99aa-a8254cf5804c None admin] RBAC: Adding query filter params (name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:49.417527 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875e281-1e3b-4413-99aa-a8254cf5804c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:49.418890 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875e281-1e3b-4413-99aa-a8254cf5804c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:49.424156 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:49.427578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 272/535] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:49.433005 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08e875-7f92-4e28-8ae3-430964a411d0 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:49.542971 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08e875-7f92-4e28-8ae3-430964a411d0 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:49.579678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeea7d0-2284-45a3-af92-116d7d45743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:49.580484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeea7d0-2284-45a3-af92-116d7d45743e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:49.580766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeea7d0-2284-45a3-af92-116d7d45743e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:49.581040 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeea7d0-2284-45a3-af92-116d7d45743e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:49.592244 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeea7d0-2284-45a3-af92-116d7d45743e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:49.593763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeea7d0-2284-45a3-af92-116d7d45743e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-aaeea7d0-2284-45a3-af92-116d7d45743e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:49.611180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:49.612077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:49.612920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:49.612920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:49.612920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:49.612920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:49.612920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 264/536] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:49.618344 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875e281-1e3b-4413-99aa-a8254cf5804c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:49.681246 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd68d92-49ca-4ce6-8618-16f9c7a94089 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:49.681887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd68d92-49ca-4ce6-8618-16f9c7a94089 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:49.682358 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd68d92-49ca-4ce6-8618-16f9c7a94089 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:49.683930 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 265/537] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:42:49.689755 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fdc43-6f27-4dc8-b708-328840c1329f None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:49.690286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fdc43-6f27-4dc8-b708-328840c1329f None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:49.690752 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fdc43-6f27-4dc8-b708-328840c1329f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:49.707932 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-8e0fdc43-6f27-4dc8-b708-328840c1329f None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:49.709667 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-8e0fdc43-6f27-4dc8-b708-328840c1329f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:49.712026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:49.735729 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875e281-1e3b-4413-99aa-a8254cf5804c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:49.773834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dbc85-8937-470b-a174-c2afedf4d868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:49.774668 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dbc85-8937-470b-a174-c2afedf4d868 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:49.775016 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dbc85-8937-470b-a174-c2afedf4d868 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:49.775357 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dbc85-8937-470b-a174-c2afedf4d868 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:49.776242 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dbc85-8937-470b-a174-c2afedf4d868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:49.776877 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dbc85-8937-470b-a174-c2afedf4d868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:49.778457 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dbc85-8937-470b-a174-c2afedf4d868 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:49.787465 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 266/538] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:49.792456 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 273/539] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:49.798071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dbc85-8937-470b-a174-c2afedf4d868 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:49.814321 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fdc43-6f27-4dc8-b708-328840c1329f None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:49.882651 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:49.932346 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dbc85-8937-470b-a174-c2afedf4d868 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:49.950193 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fdc43-6f27-4dc8-b708-328840c1329f None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:49.973084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378a1e-5a74-4ecb-ab4b-db88aacc60ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:49.973911 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378a1e-5a74-4ecb-ab4b-db88aacc60ef None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:49.974196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378a1e-5a74-4ecb-ab4b-db88aacc60ef None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:49.974475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378a1e-5a74-4ecb-ab4b-db88aacc60ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:49.982522 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82378a1e-5a74-4ecb-ab4b-db88aacc60ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:49.984526 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82378a1e-5a74-4ecb-ab4b-db88aacc60ef None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:49.991025 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856071c-9972-4fa7-9e7c-c4250fdd071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:49.992333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856071c-9972-4fa7-9e7c-c4250fdd071b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:49.992619 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856071c-9972-4fa7-9e7c-c4250fdd071b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:49.992996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856071c-9972-4fa7-9e7c-c4250fdd071b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-82378a1e-5a74-4ecb-ab4b-db88aacc60ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:50.000001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:50.001155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:50.002722 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 274/540] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Jul 12 18:42:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:50.003546 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c221-2150-4489-bd42-0e323a43503d None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.003546 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c221-2150-4489-bd42-0e323a43503d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.003546 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40c221-2150-4489-bd42-0e323a43503d None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.004224 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:50.008951 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 275/541] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:50.008951 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40c221-2150-4489-bd42-0e323a43503d None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.012181 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856071c-9972-4fa7-9e7c-c4250fdd071b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-3856071c-9972-4fa7-9e7c-c4250fdd071b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:50.020052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:50.020921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:50.021769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 267/542] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:50.022455 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815321ba-78f4-4bf3-8b52-b7a52cd3ded7 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.022871 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815321ba-78f4-4bf3-8b52-b7a52cd3ded7 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.023023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815321ba-78f4-4bf3-8b52-b7a52cd3ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.041298 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-815321ba-78f4-4bf3-8b52-b7a52cd3ded7 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:50.042488 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-815321ba-78f4-4bf3-8b52-b7a52cd3ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:50.115077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 268/543] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:50.115825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815321ba-78f4-4bf3-8b52-b7a52cd3ded7 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.117243 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40c221-2150-4489-bd42-0e323a43503d None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.139678 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:50.153677 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f71fa0-f2f5-4bb6-aa7b-35d28e431912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.154333 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f71fa0-f2f5-4bb6-aa7b-35d28e431912 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.154616 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f71fa0-f2f5-4bb6-aa7b-35d28e431912 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.154887 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f71fa0-f2f5-4bb6-aa7b-35d28e431912 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.156216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f71fa0-f2f5-4bb6-aa7b-35d28e431912 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:50.156518 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f71fa0-f2f5-4bb6-aa7b-35d28e431912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:50.157978 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f71fa0-f2f5-4bb6-aa7b-35d28e431912 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:50.174905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 276/544] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:50.176171 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a5861-c5c4-49ab-854d-5ee4bad8abc0 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.176460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a5861-c5c4-49ab-854d-5ee4bad8abc0 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.176735 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a5861-c5c4-49ab-854d-5ee4bad8abc0 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.177980 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 277/545] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:50.178672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a5861-c5c4-49ab-854d-5ee4bad8abc0 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.221118 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815321ba-78f4-4bf3-8b52-b7a52cd3ded7 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.253033 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:50.266023 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa780-9e04-461d-90fc-9722fbf00315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.266697 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa780-9e04-461d-90fc-9722fbf00315 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.266987 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa780-9e04-461d-90fc-9722fbf00315 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.267267 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa780-9e04-461d-90fc-9722fbf00315 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.268016 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa780-9e04-461d-90fc-9722fbf00315 None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:50.268323 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa780-9e04-461d-90fc-9722fbf00315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:50.269753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa780-9e04-461d-90fc-9722fbf00315 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:50.277972 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 269/546] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:50.278910 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa780-9e04-461d-90fc-9722fbf00315 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.287492 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a5861-c5c4-49ab-854d-5ee4bad8abc0 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.320474 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f157c-91a0-4950-977c-c7265a5e88c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.321247 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f157c-91a0-4950-977c-c7265a5e88c0 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.321563 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f157c-91a0-4950-977c-c7265a5e88c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.321836 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f157c-91a0-4950-977c-c7265a5e88c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.331589 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f157c-91a0-4950-977c-c7265a5e88c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-d58f157c-91a0-4950-977c-c7265a5e88c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:50.339251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:50.340149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:50.340946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 278/547] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:50.342221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d3ea8-9095-47b3-957f-758df7db60e1 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.342221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d3ea8-9095-47b3-957f-758df7db60e1 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.342221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d3ea8-9095-47b3-957f-758df7db60e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.358207 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-192d3ea8-9095-47b3-957f-758df7db60e1 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:50.359942 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-192d3ea8-9095-47b3-957f-758df7db60e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:50.379308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa780-9e04-461d-90fc-9722fbf00315 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.388271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:50.412048 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fe5c7-e6b3-4b87-8deb-74ba4f521578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.412825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fe5c7-e6b3-4b87-8deb-74ba4f521578 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.413104 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fe5c7-e6b3-4b87-8deb-74ba4f521578 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.413405 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0fe5c7-e6b3-4b87-8deb-74ba4f521578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.424242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fe5c7-e6b3-4b87-8deb-74ba4f521578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:50.424791 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 279/548] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:50.425636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d3ea8-9095-47b3-957f-758df7db60e1 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.425737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0fe5c7-e6b3-4b87-8deb-74ba4f521578 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-ea0fe5c7-e6b3-4b87-8deb-74ba4f521578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:50.442255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:50.443097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:50.443931 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:50.443931 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:50.443931 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:50.443931 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:50.447042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 270/549] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:50.447042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fe5c7-e6b3-4b87-8deb-74ba4f521578 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.488040 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:50.536904 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d3ea8-9095-47b3-957f-758df7db60e1 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.542872 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0fe5c7-e6b3-4b87-8deb-74ba4f521578 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.570099 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08afb7b-62d3-4387-ae13-8a729da7bffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.570875 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08afb7b-62d3-4387-ae13-8a729da7bffc None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.571159 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08afb7b-62d3-4387-ae13-8a729da7bffc None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.571435 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08afb7b-62d3-4387-ae13-8a729da7bffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.574889 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f35d69-0011-4478-93a8-11b96b635737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.575540 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f35d69-0011-4478-93a8-11b96b635737 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.575819 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f35d69-0011-4478-93a8-11b96b635737 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.576091 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f35d69-0011-4478-93a8-11b96b635737 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.576820 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f35d69-0011-4478-93a8-11b96b635737 None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:50.577119 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f35d69-0011-4478-93a8-11b96b635737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:50.579050 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f35d69-0011-4478-93a8-11b96b635737 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:50.582209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08afb7b-62d3-4387-ae13-8a729da7bffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:50.583665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08afb7b-62d3-4387-ae13-8a729da7bffc None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:50.586852 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 271/550] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:50.587621 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f35d69-0011-4478-93a8-11b96b635737 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-d08afb7b-62d3-4387-ae13-8a729da7bffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:50.603143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:50.603977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:50.604841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:50.604841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:50.604841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:50.604841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:50.604841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 280/551] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:50.605172 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08afb7b-62d3-4387-ae13-8a729da7bffc None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.627785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:50.687799 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f35d69-0011-4478-93a8-11b96b635737 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.690008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:50.704272 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08afb7b-62d3-4387-ae13-8a729da7bffc None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.721615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ca8e4-d9dc-4007-bc89-b618ca74188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.722403 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ca8e4-d9dc-4007-bc89-b618ca74188b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.722917 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ca8e4-d9dc-4007-bc89-b618ca74188b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.723079 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ca8e4-d9dc-4007-bc89-b618ca74188b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.733102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ca8e4-d9dc-4007-bc89-b618ca74188b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:50.738935 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e1de-e8e4-466d-8f62-c02e8778bb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.739584 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e1de-e8e4-466d-8f62-c02e8778bb07 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.739864 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e1de-e8e4-466d-8f62-c02e8778bb07 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.740135 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e1de-e8e4-466d-8f62-c02e8778bb07 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.740838 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024e1de-e8e4-466d-8f62-c02e8778bb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-027ca8e4-d9dc-4007-bc89-b618ca74188b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:50.740934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:50.742213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:50.743183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:50.743787 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024e1de-e8e4-466d-8f62-c02e8778bb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:50.743787 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024e1de-e8e4-466d-8f62-c02e8778bb07 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:50.747174 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 272/552] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:50.747943 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ca8e4-d9dc-4007-bc89-b618ca74188b None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.754163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 281/553] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:50.754963 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e1de-e8e4-466d-8f62-c02e8778bb07 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.833378 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:50.848463 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ca8e4-d9dc-4007-bc89-b618ca74188b None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.852110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e1de-e8e4-466d-8f62-c02e8778bb07 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:50.882293 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88bf51-72d1-4717-b9bd-7e09f2dc166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.882763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88bf51-72d1-4717-b9bd-7e09f2dc166e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.883040 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88bf51-72d1-4717-b9bd-7e09f2dc166e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.883312 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88bf51-72d1-4717-b9bd-7e09f2dc166e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.893312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cee8e6-d462-4a2f-89c3-fad4db692f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:50.893971 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cee8e6-d462-4a2f-89c3-fad4db692f0a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:50.894259 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cee8e6-d462-4a2f-89c3-fad4db692f0a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:50.894364 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88bf51-72d1-4717-b9bd-7e09f2dc166e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:50.894536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cee8e6-d462-4a2f-89c3-fad4db692f0a None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:50.895249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cee8e6-d462-4a2f-89c3-fad4db692f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:50.895553 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cee8e6-d462-4a2f-89c3-fad4db692f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:50.895725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de88bf51-72d1-4717-b9bd-7e09f2dc166e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:50.896902 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cee8e6-d462-4a2f-89c3-fad4db692f0a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:50.908654 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 282/554] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:50.909466 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cee8e6-d462-4a2f-89c3-fad4db692f0a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-de88bf51-72d1-4717-b9bd-7e09f2dc166e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:50.912456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:50.913480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:50.914330 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:50.914330 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:50.914330 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:50.914330 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:50.914330 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 273/555] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:50.914615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88bf51-72d1-4717-b9bd-7e09f2dc166e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:50.931862 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:51.009266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cee8e6-d462-4a2f-89c3-fad4db692f0a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.012515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88bf51-72d1-4717-b9bd-7e09f2dc166e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.043034 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7e00-a42b-437f-af69-ab7a0905c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.043693 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7e00-a42b-437f-af69-ab7a0905c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.043980 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7e00-a42b-437f-af69-ab7a0905c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.044260 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7e00-a42b-437f-af69-ab7a0905c1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.044998 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc7e00-a42b-437f-af69-ab7a0905c1c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:51.045340 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33487ee-ec35-4e2d-89f4-9770095146cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.045454 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc7e00-a42b-437f-af69-ab7a0905c1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.046143 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33487ee-ec35-4e2d-89f4-9770095146cd None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.046410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33487ee-ec35-4e2d-89f4-9770095146cd None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.046687 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33487ee-ec35-4e2d-89f4-9770095146cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.046775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc7e00-a42b-437f-af69-ab7a0905c1c7 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.053235 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33487ee-ec35-4e2d-89f4-9770095146cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.054517 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 283/556] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:51.054683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33487ee-ec35-4e2d-89f4-9770095146cd None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.055353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7e00-a42b-437f-af69-ab7a0905c1c7 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.061242 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-d33487ee-ec35-4e2d-89f4-9770095146cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:51.073675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:51.074664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:51.075535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:51.075535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:51.075535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:51.075535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:51.075535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:51.075535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:51.075535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:51.075535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:51.075535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 274/557] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:51.076007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33487ee-ec35-4e2d-89f4-9770095146cd None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.157748 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:51.167011 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7e00-a42b-437f-af69-ab7a0905c1c7 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.180554 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33487ee-ec35-4e2d-89f4-9770095146cd None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.201366 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbac51-e5c3-4454-a84f-4ac1566d70f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.202163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbac51-e5c3-4454-a84f-4ac1566d70f0 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.202448 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbac51-e5c3-4454-a84f-4ac1566d70f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.202726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbac51-e5c3-4454-a84f-4ac1566d70f0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.210008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbac51-e5c3-4454-a84f-4ac1566d70f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.211441 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbac51-e5c3-4454-a84f-4ac1566d70f0 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.214462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dfba5-dbdf-4455-8145-d074aab1e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.215117 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dfba5-dbdf-4455-8145-d074aab1e1fe None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.215402 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dfba5-dbdf-4455-8145-d074aab1e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.215681 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dfba5-dbdf-4455-8145-d074aab1e1fe None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.216392 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dfba5-dbdf-4455-8145-d074aab1e1fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:51.216700 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dfba5-dbdf-4455-8145-d074aab1e1fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.218102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dfba5-dbdf-4455-8145-d074aab1e1fe None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-54dbac51-e5c3-4454-a84f-4ac1566d70f0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:51.225724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:51.227212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 284/558] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:51.228857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbac51-e5c3-4454-a84f-4ac1566d70f0 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.238921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 275/559] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:51.238921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dfba5-dbdf-4455-8145-d074aab1e1fe None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.295032 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:51.334348 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbac51-e5c3-4454-a84f-4ac1566d70f0 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.337384 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dfba5-dbdf-4455-8145-d074aab1e1fe None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.367135 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09487758-a884-4672-9e5b-07d22eb513a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.367917 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487758-a884-4672-9e5b-07d22eb513a7 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.368205 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487758-a884-4672-9e5b-07d22eb513a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.368481 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487758-a884-4672-9e5b-07d22eb513a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.370029 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854daba6-9ca2-4d3e-b485-9051f361eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.370719 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854daba6-9ca2-4d3e-b485-9051f361eee4 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.370998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854daba6-9ca2-4d3e-b485-9051f361eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.371309 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854daba6-9ca2-4d3e-b485-9051f361eee4 None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.372084 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854daba6-9ca2-4d3e-b485-9051f361eee4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:51.372391 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854daba6-9ca2-4d3e-b485-9051f361eee4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.373869 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854daba6-9ca2-4d3e-b485-9051f361eee4 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.376909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:51.379775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09487758-a884-4672-9e5b-07d22eb513a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.381200 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09487758-a884-4672-9e5b-07d22eb513a7 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.387783 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 276/560] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:51.388521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854daba6-9ca2-4d3e-b485-9051f361eee4 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-09487758-a884-4672-9e5b-07d22eb513a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:51.401798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:51.402795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:51.403859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:51.403859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:51.403859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:51.403859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:51.403859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 285/561] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:51.404311 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09487758-a884-4672-9e5b-07d22eb513a7 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.492112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854daba6-9ca2-4d3e-b485-9051f361eee4 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.506911 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09487758-a884-4672-9e5b-07d22eb513a7 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.520919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:51.526027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f971fbc-1888-4582-b506-9d78aed03c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.526693 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f971fbc-1888-4582-b506-9d78aed03c8d None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.526978 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f971fbc-1888-4582-b506-9d78aed03c8d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.527257 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f971fbc-1888-4582-b506-9d78aed03c8d None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.528082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f971fbc-1888-4582-b506-9d78aed03c8d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:51.528393 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f971fbc-1888-4582-b506-9d78aed03c8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.529866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f971fbc-1888-4582-b506-9d78aed03c8d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.542353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a98c8-f110-49ed-83ca-0a9e9627e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.543132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a98c8-f110-49ed-83ca-0a9e9627e492 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.543410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a98c8-f110-49ed-83ca-0a9e9627e492 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.543686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a98c8-f110-49ed-83ca-0a9e9627e492 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.548067 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 277/562] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:51.549095 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f971fbc-1888-4582-b506-9d78aed03c8d None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.552187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a98c8-f110-49ed-83ca-0a9e9627e492 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.553652 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a98c8-f110-49ed-83ca-0a9e9627e492 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-920a98c8-f110-49ed-83ca-0a9e9627e492 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:51.568504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:51.569686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 286/563] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:51.570647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a98c8-f110-49ed-83ca-0a9e9627e492 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.607595 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:51.651902 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f971fbc-1888-4582-b506-9d78aed03c8d None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.666860 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a98c8-f110-49ed-83ca-0a9e9627e492 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.685394 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15cc9e-4639-48e2-9548-551bdb3f4190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.686274 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15cc9e-4639-48e2-9548-551bdb3f4190 None admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.686555 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15cc9e-4639-48e2-9548-551bdb3f4190 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.686853 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15cc9e-4639-48e2-9548-551bdb3f4190 None admin] PATH_INFO: `/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/72918f9adc4240d99640b419e013b343/roles/5d30b117c7cb45a6ae69d3f19986213d` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.699295 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed3553-9627-49e6-b493-904c12960699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.699945 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed3553-9627-49e6-b493-904c12960699 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.700227 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed3553-9627-49e6-b493-904c12960699 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.700501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed3553-9627-49e6-b493-904c12960699 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.700729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15cc9e-4639-48e2-9548-551bdb3f4190 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae279b6ea9b04682832e4f2aaf4f9a00, user_id=72918f9adc4240d99640b419e013b343, role_id=5d30b117c7cb45a6ae69d3f19986213d)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.701213 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed3553-9627-49e6-b493-904c12960699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:51.701552 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed3553-9627-49e6-b493-904c12960699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.702241 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b15cc9e-4639-48e2-9548-551bdb3f4190 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.702931 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed3553-9627-49e6-b493-904c12960699 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.714698 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 287/564] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:51.715667 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed3553-9627-49e6-b493-904c12960699 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.725560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 278/565] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:42:51 2022] PUT /identity/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/72918f9adc4240d99640b419e013b343/roles/5d30b117c7cb45a6ae69d3f19986213d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:51.725560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15cc9e-4639-48e2-9548-551bdb3f4190 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.763070 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:51.835943 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15cc9e-4639-48e2-9548-551bdb3f4190 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.838887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:51.882404 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed3553-9627-49e6-b493-904c12960699 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:51.882791 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae2b52-2729-4c07-90f4-b7572fdcae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.883712 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae2b52-2729-4c07-90f4-b7572fdcae12 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.884190 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae2b52-2729-4c07-90f4-b7572fdcae12 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.884673 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae2b52-2729-4c07-90f4-b7572fdcae12 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.885946 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae2b52-2729-4c07-90f4-b7572fdcae12 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:51.886322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae2b52-2729-4c07-90f4-b7572fdcae12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.887853 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae2b52-2729-4c07-90f4-b7572fdcae12 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.912272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 279/566] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:51.912842 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae2b52-2729-4c07-90f4-b7572fdcae12 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:51.934997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffb911-1121-4565-9d6f-97a118c03fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:51.936169 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffb911-1121-4565-9d6f-97a118c03fee None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:51.936632 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffb911-1121-4565-9d6f-97a118c03fee None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:51.937122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffb911-1121-4565-9d6f-97a118c03fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:51.949211 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffb911-1121-4565-9d6f-97a118c03fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:51.950977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffb911-1121-4565-9d6f-97a118c03fee None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-87ffb911-1121-4565-9d6f-97a118c03fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:51.971394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:51.972360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:51.973261 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:51.973261 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:51.973261 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:51.973261 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:51.980462 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 288/567] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:51.981880 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffb911-1121-4565-9d6f-97a118c03fee None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.045008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae2b52-2729-4c07-90f4-b7572fdcae12 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.076732 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:52.082655 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868466c7-9e54-41d1-87a6-ef5c29251f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.083539 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868466c7-9e54-41d1-87a6-ef5c29251f6e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.083733 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868466c7-9e54-41d1-87a6-ef5c29251f6e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.083993 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868466c7-9e54-41d1-87a6-ef5c29251f6e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.092169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868466c7-9e54-41d1-87a6-ef5c29251f6e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.094380 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868466c7-9e54-41d1-87a6-ef5c29251f6e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.096835 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffb911-1121-4565-9d6f-97a118c03fee None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-868466c7-9e54-41d1-87a6-ef5c29251f6e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:52.110242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:52.111188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:52.112136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 280/568] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:52.112729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868466c7-9e54-41d1-87a6-ef5c29251f6e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.137388 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:52.139467 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1f4e9-5f75-40a0-bbb5-fa6646b7033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.140870 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1f4e9-5f75-40a0-bbb5-fa6646b7033b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.141155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1f4e9-5f75-40a0-bbb5-fa6646b7033b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.141509 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1f4e9-5f75-40a0-bbb5-fa6646b7033b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.153162 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1f4e9-5f75-40a0-bbb5-fa6646b7033b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.154922 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1f4e9-5f75-40a0-bbb5-fa6646b7033b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-9bd1f4e9-5f75-40a0-bbb5-fa6646b7033b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:52.173024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:52.173968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:52.174869 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:52.174869 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:52.174869 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:52.174869 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:52.174869 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 289/569] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:52.175145 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1f4e9-5f75-40a0-bbb5-fa6646b7033b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.220598 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868466c7-9e54-41d1-87a6-ef5c29251f6e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.266933 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b663fa-5e2f-4c6f-a1e1-114fdfdf113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.267688 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b663fa-5e2f-4c6f-a1e1-114fdfdf113a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.268040 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b663fa-5e2f-4c6f-a1e1-114fdfdf113a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.268399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b663fa-5e2f-4c6f-a1e1-114fdfdf113a None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.269176 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b663fa-5e2f-4c6f-a1e1-114fdfdf113a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:52.269574 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b663fa-5e2f-4c6f-a1e1-114fdfdf113a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.270948 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b663fa-5e2f-4c6f-a1e1-114fdfdf113a None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.283256 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 281/570] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:52.288180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b663fa-5e2f-4c6f-a1e1-114fdfdf113a None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.295783 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1f4e9-5f75-40a0-bbb5-fa6646b7033b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.333083 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb8a16-03af-4a0d-a76c-ebc16dbc8cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.334132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8a16-03af-4a0d-a76c-ebc16dbc8cc4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.334417 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8a16-03af-4a0d-a76c-ebc16dbc8cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.334693 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb8a16-03af-4a0d-a76c-ebc16dbc8cc4 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.335836 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb8a16-03af-4a0d-a76c-ebc16dbc8cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:52.336145 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb8a16-03af-4a0d-a76c-ebc16dbc8cc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.337580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb8a16-03af-4a0d-a76c-ebc16dbc8cc4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.346153 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:52.361186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 290/571] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Jul 12 18:42:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:52.362568 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb8a16-03af-4a0d-a76c-ebc16dbc8cc4 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.379463 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:52.401185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b663fa-5e2f-4c6f-a1e1-114fdfdf113a None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.439338 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c42df-918d-48f5-9f98-10575b34798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.440024 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c42df-918d-48f5-9f98-10575b34798f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.440399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c42df-918d-48f5-9f98-10575b34798f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.440676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c42df-918d-48f5-9f98-10575b34798f None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.441417 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c42df-918d-48f5-9f98-10575b34798f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:52.441725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c42df-918d-48f5-9f98-10575b34798f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.443218 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c42df-918d-48f5-9f98-10575b34798f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.460441 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 282/572] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:52.460441 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c42df-918d-48f5-9f98-10575b34798f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.467962 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb8a16-03af-4a0d-a76c-ebc16dbc8cc4 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.502225 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c9b13-cbda-4891-a6fc-47c05070215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.503099 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c9b13-cbda-4891-a6fc-47c05070215f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.503450 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c9b13-cbda-4891-a6fc-47c05070215f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.503790 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c9b13-cbda-4891-a6fc-47c05070215f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.510524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c9b13-cbda-4891-a6fc-47c05070215f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.511941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c9b13-cbda-4891-a6fc-47c05070215f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-e28c9b13-cbda-4891-a6fc-47c05070215f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:52.526091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:52.526986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:52.527862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:52.527862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:52.527862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:52.527862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:52.527862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:52.527862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:52.527862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:52.527862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:52.527862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 291/573] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:52.528380 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c9b13-cbda-4891-a6fc-47c05070215f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.570141 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c42df-918d-48f5-9f98-10575b34798f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.592289 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:52.606095 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff04162-ee85-4c2e-aee0-935131f93787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.606816 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff04162-ee85-4c2e-aee0-935131f93787 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.607181 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff04162-ee85-4c2e-aee0-935131f93787 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.607373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff04162-ee85-4c2e-aee0-935131f93787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.617389 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff04162-ee85-4c2e-aee0-935131f93787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.618814 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff04162-ee85-4c2e-aee0-935131f93787 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.620527 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-bff04162-ee85-4c2e-aee0-935131f93787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:52.637680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:52.638767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:52.639732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:52.639732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:52.639732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:52.639732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:52.639732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 283/574] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:52.640085 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff04162-ee85-4c2e-aee0-935131f93787 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.646191 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c9b13-cbda-4891-a6fc-47c05070215f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.681025 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e4386-23c5-477e-b5bf-9e6f8ecdc79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.682026 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e4386-23c5-477e-b5bf-9e6f8ecdc79a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.682401 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e4386-23c5-477e-b5bf-9e6f8ecdc79a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.682771 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e4386-23c5-477e-b5bf-9e6f8ecdc79a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.690296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e4386-23c5-477e-b5bf-9e6f8ecdc79a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.691823 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e4386-23c5-477e-b5bf-9e6f8ecdc79a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-224e4386-23c5-477e-b5bf-9e6f8ecdc79a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:52.706579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:52.707682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:52.708636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:52.708636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:52.708636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:52.708636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:52.708636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:52.708636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:52.708636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:52.708636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:52.709101 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 292/575] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:52.709855 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e4386-23c5-477e-b5bf-9e6f8ecdc79a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.760483 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff04162-ee85-4c2e-aee0-935131f93787 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.794590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9386b3-d0d9-4aca-bc8a-99adb757ba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.795312 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9386b3-d0d9-4aca-bc8a-99adb757ba8a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.795597 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9386b3-d0d9-4aca-bc8a-99adb757ba8a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.795869 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9386b3-d0d9-4aca-bc8a-99adb757ba8a None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.797203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9386b3-d0d9-4aca-bc8a-99adb757ba8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:52.797539 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9386b3-d0d9-4aca-bc8a-99adb757ba8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.798967 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9386b3-d0d9-4aca-bc8a-99adb757ba8a None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.810112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 284/576] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:52.810112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9386b3-d0d9-4aca-bc8a-99adb757ba8a None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.825376 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e4386-23c5-477e-b5bf-9e6f8ecdc79a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.848254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:52.870864 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:52.872053 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9b6a9-823b-4994-a97f-c29ffc781631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.872745 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9b6a9-823b-4994-a97f-c29ffc781631 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.873357 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9b6a9-823b-4994-a97f-c29ffc781631 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.873357 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9b6a9-823b-4994-a97f-c29ffc781631 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.874073 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9b6a9-823b-4994-a97f-c29ffc781631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:52.874935 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9b6a9-823b-4994-a97f-c29ffc781631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.876330 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a9b6a9-823b-4994-a97f-c29ffc781631 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.897887 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 293/577] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:52.897887 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9b6a9-823b-4994-a97f-c29ffc781631 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:52.926322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9386b3-d0d9-4aca-bc8a-99adb757ba8a None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:52.963321 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8634a93-e9b5-452b-ab67-18ff101fd322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:52.964288 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8634a93-e9b5-452b-ab67-18ff101fd322 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:52.964769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8634a93-e9b5-452b-ab67-18ff101fd322 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:52.965042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8634a93-e9b5-452b-ab67-18ff101fd322 None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:52.965841 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8634a93-e9b5-452b-ab67-18ff101fd322 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:52.966150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8634a93-e9b5-452b-ab67-18ff101fd322 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:52.967846 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8634a93-e9b5-452b-ab67-18ff101fd322 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:52.980067 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 285/578] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:52.980866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8634a93-e9b5-452b-ab67-18ff101fd322 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:53.012983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9b6a9-823b-4994-a97f-c29ffc781631 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:53.049110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17c1f3-f322-4ff9-be61-e886ff784a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:53.050120 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c1f3-f322-4ff9-be61-e886ff784a38 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:53.050397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c1f3-f322-4ff9-be61-e886ff784a38 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:53.050673 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17c1f3-f322-4ff9-be61-e886ff784a38 None admin] PATH_INFO: `/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/86c0b548be2d4948bca2817337fdee5f/roles/5d30b117c7cb45a6ae69d3f19986213d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:53.066776 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17c1f3-f322-4ff9-be61-e886ff784a38 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae279b6ea9b04682832e4f2aaf4f9a00, user_id=86c0b548be2d4948bca2817337fdee5f, role_id=5d30b117c7cb45a6ae69d3f19986213d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:53.068385 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17c1f3-f322-4ff9-be61-e886ff784a38 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:53.093510 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 294/579] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:42:52 2022] PUT /identity/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/86c0b548be2d4948bca2817337fdee5f/roles/5d30b117c7cb45a6ae69d3f19986213d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:53.093510 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17c1f3-f322-4ff9-be61-e886ff784a38 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:53.094272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8634a93-e9b5-452b-ab67-18ff101fd322 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:53.111071 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:53.126280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:53.137015 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b664937-c9db-44af-83bc-703d2debb455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:53.138662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b664937-c9db-44af-83bc-703d2debb455 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:53.138955 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b664937-c9db-44af-83bc-703d2debb455 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:53.139226 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b664937-c9db-44af-83bc-703d2debb455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:53.147009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b664937-c9db-44af-83bc-703d2debb455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:53.148648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b664937-c9db-44af-83bc-703d2debb455 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-2b664937-c9db-44af-83bc-703d2debb455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:53.164731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:53.165785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:53.166763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:53.166763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:53.166763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:53.166763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:53.166763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:53.166763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:53.166763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:53.166763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:53.169895 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 286/580] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:53.172922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b664937-c9db-44af-83bc-703d2debb455 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:53.216498 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17c1f3-f322-4ff9-be61-e886ff784a38 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:53.257196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cf202-ff28-43df-bc60-9f1fff5ef101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:53.258469 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cf202-ff28-43df-bc60-9f1fff5ef101 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:53.258584 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cf202-ff28-43df-bc60-9f1fff5ef101 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:53.258873 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cf202-ff28-43df-bc60-9f1fff5ef101 None admin] PATH_INFO: `/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/b296e5ba36b243009b5fcfe708506c00/roles/5d30b117c7cb45a6ae69d3f19986213d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:53.277473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cf202-ff28-43df-bc60-9f1fff5ef101 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae279b6ea9b04682832e4f2aaf4f9a00, user_id=b296e5ba36b243009b5fcfe708506c00, role_id=5d30b117c7cb45a6ae69d3f19986213d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:53.279046 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cf202-ff28-43df-bc60-9f1fff5ef101 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:53.290947 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b664937-c9db-44af-83bc-703d2debb455 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:53.301887 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 295/581] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:42:53 2022] PUT /identity/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/b296e5ba36b243009b5fcfe708506c00/roles/5d30b117c7cb45a6ae69d3f19986213d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:53.336722 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20280c14-90e3-484c-9844-ec76b6d1b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:53.337856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20280c14-90e3-484c-9844-ec76b6d1b81d None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:53.338386 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20280c14-90e3-484c-9844-ec76b6d1b81d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:53.338876 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20280c14-90e3-484c-9844-ec76b6d1b81d None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:53.339884 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20280c14-90e3-484c-9844-ec76b6d1b81d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:53.340424 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20280c14-90e3-484c-9844-ec76b6d1b81d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:53.342475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20280c14-90e3-484c-9844-ec76b6d1b81d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:53.357708 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 287/582] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:53.365422 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cf202-ff28-43df-bc60-9f1fff5ef101 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:53.460077 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:53.486622 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cf202-ff28-43df-bc60-9f1fff5ef101 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:53.525604 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673d2d1-19f5-4d8d-b1b0-a239b44853ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:53.526502 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673d2d1-19f5-4d8d-b1b0-a239b44853ea None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:53.526788 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673d2d1-19f5-4d8d-b1b0-a239b44853ea None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:53.527132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673d2d1-19f5-4d8d-b1b0-a239b44853ea None admin] PATH_INFO: `/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/a60cee165d0f46ef8078a91f03788410/roles/5d30b117c7cb45a6ae69d3f19986213d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:53.543559 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673d2d1-19f5-4d8d-b1b0-a239b44853ea None admin] RBAC: Authorizing `identity:create_grant(project_id=ae279b6ea9b04682832e4f2aaf4f9a00, user_id=a60cee165d0f46ef8078a91f03788410, role_id=5d30b117c7cb45a6ae69d3f19986213d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:53.545253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673d2d1-19f5-4d8d-b1b0-a239b44853ea None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:53.565157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 296/583] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:42:53 2022] PUT /identity/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/a60cee165d0f46ef8078a91f03788410/roles/5d30b117c7cb45a6ae69d3f19986213d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:42:54.005550 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303817f-e5b4-48bf-a604-2b147209c2dd None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:54.005956 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303817f-e5b4-48bf-a604-2b147209c2dd None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:54.006130 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303817f-e5b4-48bf-a604-2b147209c2dd None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:54.007604 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 288/584] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:54.012843 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a0384-6543-434f-af6a-85325aa739cf None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:54.013396 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a0384-6543-434f-af6a-85325aa739cf None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:54.013888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a0384-6543-434f-af6a-85325aa739cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:54.031213 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-da6a0384-6543-434f-af6a-85325aa739cf None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:54.032669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-da6a0384-6543-434f-af6a-85325aa739cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:54.100464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 297/585] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:54.125731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303817f-e5b4-48bf-a604-2b147209c2dd None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:54.162588 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:54.230779 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303817f-e5b4-48bf-a604-2b147209c2dd None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:54.267954 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05165ddc-b92d-41b0-821f-5c5c2e327492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:54.269114 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165ddc-b92d-41b0-821f-5c5c2e327492 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:54.269625 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165ddc-b92d-41b0-821f-5c5c2e327492 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:54.270113 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05165ddc-b92d-41b0-821f-5c5c2e327492 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:54.281858 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05165ddc-b92d-41b0-821f-5c5c2e327492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-05165ddc-b92d-41b0-821f-5c5c2e327492 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:54.289815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:54.290760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:54.291615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:54.294382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 289/586] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:54.306493 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a0384-6543-434f-af6a-85325aa739cf None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:54.357142 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:54.404261 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a0384-6543-434f-af6a-85325aa739cf None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:54.440499 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576f4c-6da6-4b92-b563-f0cd67ea5ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:54.441529 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576f4c-6da6-4b92-b563-f0cd67ea5ca8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:54.442036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576f4c-6da6-4b92-b563-f0cd67ea5ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:54.442531 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576f4c-6da6-4b92-b563-f0cd67ea5ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:54.443477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576f4c-6da6-4b92-b563-f0cd67ea5ca8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:54.443985 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576f4c-6da6-4b92-b563-f0cd67ea5ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:54.445565 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576f4c-6da6-4b92-b563-f0cd67ea5ca8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:54.454478 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 298/587] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:54.462161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05165ddc-b92d-41b0-821f-5c5c2e327492 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:54.559740 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:54.573430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05165ddc-b92d-41b0-821f-5c5c2e327492 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:54.606985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a7efd-caac-43d1-8e4c-31faf510aa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:54.608133 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7efd-caac-43d1-8e4c-31faf510aa59 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:54.609211 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7efd-caac-43d1-8e4c-31faf510aa59 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:54.609724 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a7efd-caac-43d1-8e4c-31faf510aa59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:54.620672 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a7efd-caac-43d1-8e4c-31faf510aa59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:54.622471 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a7efd-caac-43d1-8e4c-31faf510aa59 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-014a7efd-caac-43d1-8e4c-31faf510aa59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:54.640242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:54.641142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:54.642093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:54.642093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:54.642093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:54.642093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:54.644289 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 290/588] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:54.650377 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576f4c-6da6-4b92-b563-f0cd67ea5ca8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:54.750328 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576f4c-6da6-4b92-b563-f0cd67ea5ca8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:54.766983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:54.785304 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5e3c-7ec9-4472-9f17-d2fe45d376a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:54.785965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5e3c-7ec9-4472-9f17-d2fe45d376a5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:54.787490 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5e3c-7ec9-4472-9f17-d2fe45d376a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:54.787774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f5e3c-7ec9-4472-9f17-d2fe45d376a5 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:54.788483 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5e3c-7ec9-4472-9f17-d2fe45d376a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:54.788786 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5e3c-7ec9-4472-9f17-d2fe45d376a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:54.790162 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f5e3c-7ec9-4472-9f17-d2fe45d376a5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:54.802557 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 299/589] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:54.807835 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a7efd-caac-43d1-8e4c-31faf510aa59 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:54.927472 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a7efd-caac-43d1-8e4c-31faf510aa59 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:54.962725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b105a-a27e-4e3d-bff7-de219b102bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:54.963866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b105a-a27e-4e3d-bff7-de219b102bab None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:54.964357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b105a-a27e-4e3d-bff7-de219b102bab None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:54.964842 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b105a-a27e-4e3d-bff7-de219b102bab None admin] PATH_INFO: `/v3/users/nova` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:54.973438 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b105a-a27e-4e3d-bff7-de219b102bab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:54.975130 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b105a-a27e-4e3d-bff7-de219b102bab None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-5d1b105a-a27e-4e3d-bff7-de219b102bab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:54.989496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:54.990462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:54.991398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:54.991398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:54.991398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:54.991398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:54.991398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:54.991398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:54.991398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:54.991398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:54.991398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:42:54.991398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:54.994007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 291/590] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Jul 12 18:42:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:55.005378 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5e3c-7ec9-4472-9f17-d2fe45d376a5 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:55.103788 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f5e3c-7ec9-4472-9f17-d2fe45d376a5 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:55.138302 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f2446-36b7-4d5e-838d-553ed158fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:55.138972 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f2446-36b7-4d5e-838d-553ed158fd7e None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:55.139256 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f2446-36b7-4d5e-838d-553ed158fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:55.139533 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f2446-36b7-4d5e-838d-553ed158fd7e None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:55.140908 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f2446-36b7-4d5e-838d-553ed158fd7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:55.141217 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f2446-36b7-4d5e-838d-553ed158fd7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:55.142652 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f2446-36b7-4d5e-838d-553ed158fd7e None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:55.160579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 300/591] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Jul 12 18:42:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:55.165821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b105a-a27e-4e3d-bff7-de219b102bab None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:55.189661 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:55.268356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b105a-a27e-4e3d-bff7-de219b102bab None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:55.308003 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffd7f4-c91d-476f-a3c6-a529efb620d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:55.309085 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffd7f4-c91d-476f-a3c6-a529efb620d0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:55.309620 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffd7f4-c91d-476f-a3c6-a529efb620d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:55.310060 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffd7f4-c91d-476f-a3c6-a529efb620d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:55.381897 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffd7f4-c91d-476f-a3c6-a529efb620d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:55.383835 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffd7f4-c91d-476f-a3c6-a529efb620d0 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:55.392595 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:55.491160 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 292/592] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:55.496543 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f2446-36b7-4d5e-838d-553ed158fd7e None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:55.533808 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:55.579422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75820ce6-4793-4115-b32e-b90eb4503066 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:55.580050 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75820ce6-4793-4115-b32e-b90eb4503066 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:55.580527 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75820ce6-4793-4115-b32e-b90eb4503066 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:55.582569 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 293/593] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:55.587569 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a17f2d-1e0a-4bef-911f-1cb5498a388b None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:55.588082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a17f2d-1e0a-4bef-911f-1cb5498a388b None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:55.588672 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a17f2d-1e0a-4bef-911f-1cb5498a388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:55.604449 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f2446-36b7-4d5e-838d-553ed158fd7e None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:55.606477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-e4a17f2d-1e0a-4bef-911f-1cb5498a388b None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:55.607930 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-e4a17f2d-1e0a-4bef-911f-1cb5498a388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:55.643456 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2bc3a-41cf-46fe-ab4b-d5f6af860cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:55.644611 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2bc3a-41cf-46fe-ab4b-d5f6af860cb8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:55.645212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2bc3a-41cf-46fe-ab4b-d5f6af860cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:55.645717 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2bc3a-41cf-46fe-ab4b-d5f6af860cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:55.657226 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2bc3a-41cf-46fe-ab4b-d5f6af860cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:55.658929 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2bc3a-41cf-46fe-ab4b-d5f6af860cb8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-63d2bc3a-41cf-46fe-ab4b-d5f6af860cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:55.678515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:55.679662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:55.680765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:55.680765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:55.680765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:55.680765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:55.681942 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 294/594] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:42:55.685412 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 301/595] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:55.695077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a17f2d-1e0a-4bef-911f-1cb5498a388b None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:55.706802 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2bc3a-41cf-46fe-ab4b-d5f6af860cb8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:55.739047 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:55.799223 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:55.812392 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2bc3a-41cf-46fe-ab4b-d5f6af860cb8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:55.812609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a17f2d-1e0a-4bef-911f-1cb5498a388b None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:55.852199 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf11cec-7c5e-4200-87db-6609dd261eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:55.852449 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2bbe9-1645-479c-bf4e-a658ceeba581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:55.852997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11cec-7c5e-4200-87db-6609dd261eaf None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:55.853102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2bbe9-1645-479c-bf4e-a658ceeba581 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:55.853290 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11cec-7c5e-4200-87db-6609dd261eaf None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:55.853388 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2bbe9-1645-479c-bf4e-a658ceeba581 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:55.853606 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2bbe9-1645-479c-bf4e-a658ceeba581 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:55.853712 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf11cec-7c5e-4200-87db-6609dd261eaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:55.854318 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2bbe9-1645-479c-bf4e-a658ceeba581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:55.854618 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2bbe9-1645-479c-bf4e-a658ceeba581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:55.855981 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2bbe9-1645-479c-bf4e-a658ceeba581 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:55.867288 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf11cec-7c5e-4200-87db-6609dd261eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:55.868192 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 295/596] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:42:55.869482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae8ef-3e37-4c46-a4b6-a8d812e028c9 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:55.869770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae8ef-3e37-4c46-a4b6-a8d812e028c9 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:55.870044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae8ef-3e37-4c46-a4b6-a8d812e028c9 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:55.875273 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 296/597] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:55.876054 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae8ef-3e37-4c46-a4b6-a8d812e028c9 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-ccf11cec-7c5e-4200-87db-6609dd261eaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:55.880049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:55.880968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:55.882155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:55.885222 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 302/598] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:42:55.886595 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78276ee6-11f5-4ca6-ac58-ebba121f700a None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:55.887363 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78276ee6-11f5-4ca6-ac58-ebba121f700a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:55.887648 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78276ee6-11f5-4ca6-ac58-ebba121f700a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:55.906228 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-78276ee6-11f5-4ca6-ac58-ebba121f700a None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:55.907578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-78276ee6-11f5-4ca6-ac58-ebba121f700a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:55.977016 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 303/599] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:55.977893 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78276ee6-11f5-4ca6-ac58-ebba121f700a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:55.981901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:55.988071 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae8ef-3e37-4c46-a4b6-a8d812e028c9 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.024424 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d1149-795b-42aa-9537-9ae83d33b763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.025246 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1149-795b-42aa-9537-9ae83d33b763 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.025559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1149-795b-42aa-9537-9ae83d33b763 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.025830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1149-795b-42aa-9537-9ae83d33b763 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.033015 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d1149-795b-42aa-9537-9ae83d33b763 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:56.034485 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d1149-795b-42aa-9537-9ae83d33b763 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-c36d1149-795b-42aa-9537-9ae83d33b763 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:56.048333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:56.049426 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:56.050610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:56.050610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:56.050610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:56.050610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:56.050610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:56.050610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:56.050610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:56.050610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:56.050610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 297/600] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:56.051107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d3f7-e216-4005-bc12-d665c9092544 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.051107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d3f7-e216-4005-bc12-d665c9092544 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.051238 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11d3f7-e216-4005-bc12-d665c9092544 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.052464 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 298/601] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:56.053153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11d3f7-e216-4005-bc12-d665c9092544 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.070330 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:56.092450 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78276ee6-11f5-4ca6-ac58-ebba121f700a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.126158 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a3aa9-693d-4480-a679-bfb6c61b0ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.126817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a3aa9-693d-4480-a679-bfb6c61b0ade None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.127100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a3aa9-693d-4480-a679-bfb6c61b0ade None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.127375 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a3aa9-693d-4480-a679-bfb6c61b0ade None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.128108 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a3aa9-693d-4480-a679-bfb6c61b0ade None admin] RBAC: Adding query filter params (name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:56.128414 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a3aa9-693d-4480-a679-bfb6c61b0ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:56.129817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a3aa9-693d-4480-a679-bfb6c61b0ade None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:56.142747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 304/602] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:56.142747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a3aa9-693d-4480-a679-bfb6c61b0ade None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.159509 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11d3f7-e216-4005-bc12-d665c9092544 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.192427 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba8f16-1947-401b-a580-d644846319f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.193210 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba8f16-1947-401b-a580-d644846319f1 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.193527 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba8f16-1947-401b-a580-d644846319f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.193804 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba8f16-1947-401b-a580-d644846319f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.204492 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba8f16-1947-401b-a580-d644846319f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-deba8f16-1947-401b-a580-d644846319f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:56.212089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:56.213032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 299/603] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:56.219093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66519-f294-4852-b491-37441b5b51c0 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.219843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66519-f294-4852-b491-37441b5b51c0 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.219843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b66519-f294-4852-b491-37441b5b51c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.231545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-34b66519-f294-4852-b491-37441b5b51c0 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:56.232708 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-34b66519-f294-4852-b491-37441b5b51c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:56.236550 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a3aa9-693d-4480-a679-bfb6c61b0ade None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.243612 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:56.271013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555f0c1-a857-48a1-89da-ecbb571b6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.271667 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f0c1-a857-48a1-89da-ecbb571b6c88 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.271954 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f0c1-a857-48a1-89da-ecbb571b6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.272233 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f0c1-a857-48a1-89da-ecbb571b6c88 None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.273021 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555f0c1-a857-48a1-89da-ecbb571b6c88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:56.273388 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555f0c1-a857-48a1-89da-ecbb571b6c88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:56.275582 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555f0c1-a857-48a1-89da-ecbb571b6c88 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:56.288784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:56.297026 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 305/604] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:56.297897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555f0c1-a857-48a1-89da-ecbb571b6c88 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.302343 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 300/605] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:56.303112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b66519-f294-4852-b491-37441b5b51c0 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.401555 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b66519-f294-4852-b491-37441b5b51c0 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.406811 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555f0c1-a857-48a1-89da-ecbb571b6c88 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.435308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca064a4-2405-4369-997f-32582d142aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.436165 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca064a4-2405-4369-997f-32582d142aa0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.436447 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca064a4-2405-4369-997f-32582d142aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.437268 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca064a4-2405-4369-997f-32582d142aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.438030 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca064a4-2405-4369-997f-32582d142aa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:56.438331 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca064a4-2405-4369-997f-32582d142aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:56.439692 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca064a4-2405-4369-997f-32582d142aa0 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:56.441001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4732115-4b8b-40c4-9dd0-b506b9e9426c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.441836 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4732115-4b8b-40c4-9dd0-b506b9e9426c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.442125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4732115-4b8b-40c4-9dd0-b506b9e9426c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.442403 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4732115-4b8b-40c4-9dd0-b506b9e9426c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.452789 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 301/606] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:56.452789 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca064a4-2405-4369-997f-32582d142aa0 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.453148 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4732115-4b8b-40c4-9dd0-b506b9e9426c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:56.454742 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4732115-4b8b-40c4-9dd0-b506b9e9426c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:56.459574 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-d4732115-4b8b-40c4-9dd0-b506b9e9426c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:56.472447 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:56.473460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:56.474343 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:56.474343 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:56.474343 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:56.474343 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:56.474343 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 306/607] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:56.474609 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4732115-4b8b-40c4-9dd0-b506b9e9426c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.526507 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:56.552849 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca064a4-2405-4369-997f-32582d142aa0 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.573893 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4732115-4b8b-40c4-9dd0-b506b9e9426c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.585869 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed53564-faa4-42e8-9033-50d240034967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.586522 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed53564-faa4-42e8-9033-50d240034967 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.586805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed53564-faa4-42e8-9033-50d240034967 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.587091 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed53564-faa4-42e8-9033-50d240034967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.587904 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed53564-faa4-42e8-9033-50d240034967 None admin] RBAC: Adding query filter params (role.id=5d30b117c7cb45a6ae69d3f19986213d, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=72918f9adc4240d99640b419e013b343) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:56.588218 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed53564-faa4-42e8-9033-50d240034967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:56.589678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed53564-faa4-42e8-9033-50d240034967 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:56.595514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 302/608] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/role_assignments?user.id=72918f9adc4240d99640b419e013b343&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=5d30b117c7cb45a6ae69d3f19986213d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:56.596283 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed53564-faa4-42e8-9033-50d240034967 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.607247 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c359bf-4fa2-4715-9588-9901788df02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.608986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c359bf-4fa2-4715-9588-9901788df02c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.609236 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c359bf-4fa2-4715-9588-9901788df02c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.609631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c359bf-4fa2-4715-9588-9901788df02c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.622415 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c359bf-4fa2-4715-9588-9901788df02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-c0c359bf-4fa2-4715-9588-9901788df02c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:56.631221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:56.632249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:56.633084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 307/609] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:56.634408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c359bf-4fa2-4715-9588-9901788df02c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.682236 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:56.715575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed53564-faa4-42e8-9033-50d240034967 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.756563 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70409de-4121-482d-ac8d-7c6b60199a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.757418 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70409de-4121-482d-ac8d-7c6b60199a43 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.757710 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70409de-4121-482d-ac8d-7c6b60199a43 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.757988 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70409de-4121-482d-ac8d-7c6b60199a43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.762039 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c359bf-4fa2-4715-9588-9901788df02c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.770824 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70409de-4121-482d-ac8d-7c6b60199a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:56.772298 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70409de-4121-482d-ac8d-7c6b60199a43 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:56.778978 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-f70409de-4121-482d-ac8d-7c6b60199a43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:56.791452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:56.792396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:56.793306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:56.793306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:56.793306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:56.793306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:56.793306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 303/610] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:56.793582 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70409de-4121-482d-ac8d-7c6b60199a43 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.807483 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11e097-0e42-4812-83d5-80243b65a98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.808076 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11e097-0e42-4812-83d5-80243b65a98b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.809072 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11e097-0e42-4812-83d5-80243b65a98b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.809072 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11e097-0e42-4812-83d5-80243b65a98b None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.809490 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11e097-0e42-4812-83d5-80243b65a98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:56.809754 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11e097-0e42-4812-83d5-80243b65a98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:56.812035 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11e097-0e42-4812-83d5-80243b65a98b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:56.826538 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 308/611] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:56.826855 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11e097-0e42-4812-83d5-80243b65a98b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.917647 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70409de-4121-482d-ac8d-7c6b60199a43 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.943022 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:56.945585 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11e097-0e42-4812-83d5-80243b65a98b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:56.955786 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd54e90-205b-4c69-8cdc-aefc54612c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.956750 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd54e90-205b-4c69-8cdc-aefc54612c93 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.957185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd54e90-205b-4c69-8cdc-aefc54612c93 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.957492 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd54e90-205b-4c69-8cdc-aefc54612c93 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.958228 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd54e90-205b-4c69-8cdc-aefc54612c93 None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:56.958536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd54e90-205b-4c69-8cdc-aefc54612c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:56.960112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd54e90-205b-4c69-8cdc-aefc54612c93 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:56.969694 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 304/612] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:56.970560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd54e90-205b-4c69-8cdc-aefc54612c93 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:56.986223 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34735b-48d5-4e87-acb3-b82005d8772c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:56.987036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34735b-48d5-4e87-acb3-b82005d8772c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:56.987338 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34735b-48d5-4e87-acb3-b82005d8772c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:56.987735 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34735b-48d5-4e87-acb3-b82005d8772c None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:56.988501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34735b-48d5-4e87-acb3-b82005d8772c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:56.988806 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34735b-48d5-4e87-acb3-b82005d8772c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:56.990345 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34735b-48d5-4e87-acb3-b82005d8772c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.002865 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 309/613] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:57.002865 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34735b-48d5-4e87-acb3-b82005d8772c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:57.038160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:57.079634 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd54e90-205b-4c69-8cdc-aefc54612c93 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:57.113855 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34735b-48d5-4e87-acb3-b82005d8772c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:57.115992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01d273-1c19-4bd9-8972-f5e98eac9038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:57.116857 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01d273-1c19-4bd9-8972-f5e98eac9038 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:57.117227 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01d273-1c19-4bd9-8972-f5e98eac9038 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:57.117598 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01d273-1c19-4bd9-8972-f5e98eac9038 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:57.125457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01d273-1c19-4bd9-8972-f5e98eac9038 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:57.126969 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01d273-1c19-4bd9-8972-f5e98eac9038 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-bf01d273-1c19-4bd9-8972-f5e98eac9038 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:57.141206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:57.142307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:57.143272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 305/614] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:57.146088 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01d273-1c19-4bd9-8972-f5e98eac9038 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:57.151385 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb47d2-a326-41c0-98dc-397c1a635131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:57.152178 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb47d2-a326-41c0-98dc-397c1a635131 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:57.152456 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb47d2-a326-41c0-98dc-397c1a635131 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:57.152725 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb47d2-a326-41c0-98dc-397c1a635131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:57.164168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb47d2-a326-41c0-98dc-397c1a635131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:57.165627 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb47d2-a326-41c0-98dc-397c1a635131 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-4ffb47d2-a326-41c0-98dc-397c1a635131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:57.183315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:57.184209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:57.185071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:57.185071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:57.185071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:57.185071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:57.185071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 310/615] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:57.185385 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb47d2-a326-41c0-98dc-397c1a635131 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:57.204133 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:57.258904 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01d273-1c19-4bd9-8972-f5e98eac9038 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:57.277376 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:57.293380 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb47d2-a326-41c0-98dc-397c1a635131 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:57.296328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e706d-e001-48a7-b48f-7a12454b6550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:57.297128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e706d-e001-48a7-b48f-7a12454b6550 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:57.297442 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e706d-e001-48a7-b48f-7a12454b6550 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:57.297715 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e706d-e001-48a7-b48f-7a12454b6550 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:57.305770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e706d-e001-48a7-b48f-7a12454b6550 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:57.307360 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e706d-e001-48a7-b48f-7a12454b6550 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-6d7e706d-e001-48a7-b48f-7a12454b6550 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:57.322076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:57.323031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:57.323961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 306/616] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:42:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:57.324549 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e706d-e001-48a7-b48f-7a12454b6550 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:57.332203 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09476234-a1b2-4c45-a057-16f44f7f058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:57.332203 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09476234-a1b2-4c45-a057-16f44f7f058e None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:57.332473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09476234-a1b2-4c45-a057-16f44f7f058e None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:57.332749 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09476234-a1b2-4c45-a057-16f44f7f058e None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:57.334367 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09476234-a1b2-4c45-a057-16f44f7f058e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:57.334367 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09476234-a1b2-4c45-a057-16f44f7f058e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:57.336194 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09476234-a1b2-4c45-a057-16f44f7f058e None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.354956 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 311/617] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Jul 12 18:42:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:57.355778 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09476234-a1b2-4c45-a057-16f44f7f058e None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:57.445603 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e706d-e001-48a7-b48f-7a12454b6550 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:57.453006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:57.464118 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09476234-a1b2-4c45-a057-16f44f7f058e None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:57.481458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976bed1-3c68-48b7-a3fe-38e236872b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:57.482119 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976bed1-3c68-48b7-a3fe-38e236872b61 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:57.482403 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976bed1-3c68-48b7-a3fe-38e236872b61 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:57.482683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976bed1-3c68-48b7-a3fe-38e236872b61 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:57.483395 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976bed1-3c68-48b7-a3fe-38e236872b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:57.483699 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976bed1-3c68-48b7-a3fe-38e236872b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:57.485078 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976bed1-3c68-48b7-a3fe-38e236872b61 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.497236 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 307/618] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:57.498122 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976bed1-3c68-48b7-a3fe-38e236872b61 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:57.504143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ecd7-c86d-49d6-a1f9-cf9c1cc9ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:57.505605 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ecd7-c86d-49d6-a1f9-cf9c1cc9ec98 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:57.505888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ecd7-c86d-49d6-a1f9-cf9c1cc9ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:57.506160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00ecd7-c86d-49d6-a1f9-cf9c1cc9ec98 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:57.506979 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ecd7-c86d-49d6-a1f9-cf9c1cc9ec98 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:57.507285 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ecd7-c86d-49d6-a1f9-cf9c1cc9ec98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:57.508697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00ecd7-c86d-49d6-a1f9-cf9c1cc9ec98 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.524810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:57.529472 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 312/619] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Jul 12 18:42:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:57.531101 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ecd7-c86d-49d6-a1f9-cf9c1cc9ec98 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:57.614299 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976bed1-3c68-48b7-a3fe-38e236872b61 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:57.633640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00ecd7-c86d-49d6-a1f9-cf9c1cc9ec98 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:57.651244 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceff37d-aae0-4511-b6f8-22c2697d6051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:57.651893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff37d-aae0-4511-b6f8-22c2697d6051 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:57.652178 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff37d-aae0-4511-b6f8-22c2697d6051 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:57.652455 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceff37d-aae0-4511-b6f8-22c2697d6051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:57.668515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01bf19-416e-4a11-98aa-089321cf60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:57.669312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01bf19-416e-4a11-98aa-089321cf60d8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:57.669606 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01bf19-416e-4a11-98aa-089321cf60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:57.669877 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01bf19-416e-4a11-98aa-089321cf60d8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:57.677131 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01bf19-416e-4a11-98aa-089321cf60d8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:57.678601 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01bf19-416e-4a11-98aa-089321cf60d8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.689564 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-1a01bf19-416e-4a11-98aa-089321cf60d8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:42:57.694173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:57.695218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:57.696157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:57.696157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:57.696157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:42:57.696157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:42:57.696157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:42:57.696157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:42:57.696157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:42:57.696157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:42:57.696157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:42:57.696157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:42:57.699885 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 313/620] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:57.700707 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01bf19-416e-4a11-98aa-089321cf60d8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:57.728721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceff37d-aae0-4511-b6f8-22c2697d6051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:57.730308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceff37d-aae0-4511-b6f8-22c2697d6051 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.761483 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:57.807436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01bf19-416e-4a11-98aa-089321cf60d8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:57.837526 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 308/621] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:57.838474 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceff37d-aae0-4511-b6f8-22c2697d6051 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:57.848785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b8396-114a-4e7d-881f-427a47fdb0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:57.849882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b8396-114a-4e7d-881f-427a47fdb0a8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:57.850168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b8396-114a-4e7d-881f-427a47fdb0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:57.850443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b8396-114a-4e7d-881f-427a47fdb0a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:57.912667 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:57.930656 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b8396-114a-4e7d-881f-427a47fdb0a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:57.932102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b8396-114a-4e7d-881f-427a47fdb0a8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.948036 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceff37d-aae0-4511-b6f8-22c2697d6051 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:57.981530 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32add6d3-37d4-4a03-ab43-0404ec52efe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:57.982192 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32add6d3-37d4-4a03-ab43-0404ec52efe9 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:57.982473 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32add6d3-37d4-4a03-ab43-0404ec52efe9 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:57.982743 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32add6d3-37d4-4a03-ab43-0404ec52efe9 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:57.984129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32add6d3-37d4-4a03-ab43-0404ec52efe9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:57.984401 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32add6d3-37d4-4a03-ab43-0404ec52efe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:57.985851 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32add6d3-37d4-4a03-ab43-0404ec52efe9 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:57.991754 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:58.008746 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 309/622] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Jul 12 18:42:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:58.008746 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32add6d3-37d4-4a03-ab43-0404ec52efe9 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.047712 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 314/623] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:58.047712 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b8396-114a-4e7d-881f-427a47fdb0a8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.123964 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32add6d3-37d4-4a03-ab43-0404ec52efe9 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:58.147737 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b8396-114a-4e7d-881f-427a47fdb0a8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:58.148596 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:58.160387 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e00b6-5342-456c-93dd-98b5335d2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:58.161430 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e00b6-5342-456c-93dd-98b5335d2b2b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:58.161708 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e00b6-5342-456c-93dd-98b5335d2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:58.162017 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e00b6-5342-456c-93dd-98b5335d2b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:58.172953 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e00b6-5342-456c-93dd-98b5335d2b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:58.174445 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e00b6-5342-456c-93dd-98b5335d2b2b None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:58.183398 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acbc6a-a084-456e-9f5d-ab5ac55341bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:58.184034 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acbc6a-a084-456e-9f5d-ab5ac55341bf None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:58.184312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acbc6a-a084-456e-9f5d-ab5ac55341bf None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:58.184586 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acbc6a-a084-456e-9f5d-ab5ac55341bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-c59e00b6-5342-456c-93dd-98b5335d2b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:58.193589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:58.194641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:58.195778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:58.195778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:58.195778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:58.195778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:58.196410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 310/624] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:58.197022 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e00b6-5342-456c-93dd-98b5335d2b2b None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.218909 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:58.264580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acbc6a-a084-456e-9f5d-ab5ac55341bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:58.266070 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acbc6a-a084-456e-9f5d-ab5ac55341bf None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:58.306360 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e00b6-5342-456c-93dd-98b5335d2b2b None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:58.345757 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75ec03-d037-4168-9177-33ba6eae83b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:58.346571 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75ec03-d037-4168-9177-33ba6eae83b0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:58.346827 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75ec03-d037-4168-9177-33ba6eae83b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:58.347265 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75ec03-d037-4168-9177-33ba6eae83b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:58.362411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75ec03-d037-4168-9177-33ba6eae83b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:58.363880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75ec03-d037-4168-9177-33ba6eae83b0 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:58.380389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 315/625] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:58.380389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acbc6a-a084-456e-9f5d-ab5ac55341bf None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-0f75ec03-d037-4168-9177-33ba6eae83b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:58.383562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:58.384423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:58.385715 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:58.385715 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:58.385715 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:58.385715 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:58.385715 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 311/626] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:58.386220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75ec03-d037-4168-9177-33ba6eae83b0 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.415580 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:58.455623 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:58.500587 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acbc6a-a084-456e-9f5d-ab5ac55341bf None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:58.506592 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75ec03-d037-4168-9177-33ba6eae83b0 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:58.537967 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e450f-dd50-456d-b424-f66c9685e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:58.538616 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e450f-dd50-456d-b424-f66c9685e61b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:58.538893 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e450f-dd50-456d-b424-f66c9685e61b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:58.539163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e450f-dd50-456d-b424-f66c9685e61b None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:58.539868 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e450f-dd50-456d-b424-f66c9685e61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:58.540222 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e450f-dd50-456d-b424-f66c9685e61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:58.540842 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c1d24-c07b-4cd7-bed0-87dcd221ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:58.541539 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e450f-dd50-456d-b424-f66c9685e61b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:58.541736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c1d24-c07b-4cd7-bed0-87dcd221ad1a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:58.542024 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c1d24-c07b-4cd7-bed0-87dcd221ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:58.542303 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c1d24-c07b-4cd7-bed0-87dcd221ad1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:58.553270 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c1d24-c07b-4cd7-bed0-87dcd221ad1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:58.558009 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 316/627] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:58.558149 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c1d24-c07b-4cd7-bed0-87dcd221ad1a None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:58.558261 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e450f-dd50-456d-b424-f66c9685e61b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-c14c1d24-c07b-4cd7-bed0-87dcd221ad1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:42:58.576782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:58.578322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:58.584134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:42:58.584134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:42:58.584134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:42:58.584134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:58.584134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 312/628] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:58.584134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c1d24-c07b-4cd7-bed0-87dcd221ad1a None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.661382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:58.671619 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e450f-dd50-456d-b424-f66c9685e61b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:58.683554 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c1d24-c07b-4cd7-bed0-87dcd221ad1a None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:58.692453 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:58.707609 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976907b-39e4-43db-bdfe-27b8af0b41ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:58.708536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976907b-39e4-43db-bdfe-27b8af0b41ec None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:58.709015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976907b-39e4-43db-bdfe-27b8af0b41ec None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:58.709381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976907b-39e4-43db-bdfe-27b8af0b41ec None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:58.710165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976907b-39e4-43db-bdfe-27b8af0b41ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:58.710466 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976907b-39e4-43db-bdfe-27b8af0b41ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:58.711922 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976907b-39e4-43db-bdfe-27b8af0b41ec None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:58.718925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae83979-7229-4560-9194-5c7119f12362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:58.719709 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae83979-7229-4560-9194-5c7119f12362 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:58.719987 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae83979-7229-4560-9194-5c7119f12362 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:58.720255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae83979-7229-4560-9194-5c7119f12362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:58.728750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 317/629] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:58.728750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976907b-39e4-43db-bdfe-27b8af0b41ec None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.728992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae83979-7229-4560-9194-5c7119f12362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:58.728992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae83979-7229-4560-9194-5c7119f12362 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-0ae83979-7229-4560-9194-5c7119f12362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:58.743145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:58.744263 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:58.745536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:58.745536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:58.745536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:58.745536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:58.745536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:58.745536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:58.745536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:58.745536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:58.745536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 313/630] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:58.745536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae83979-7229-4560-9194-5c7119f12362 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.857806 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976907b-39e4-43db-bdfe-27b8af0b41ec None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:58.860835 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae83979-7229-4560-9194-5c7119f12362 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:58.899940 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacce70-7332-49d4-b8cd-e26bc882707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:58.900684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacce70-7332-49d4-b8cd-e26bc882707b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:58.901036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacce70-7332-49d4-b8cd-e26bc882707b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:58.901409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacce70-7332-49d4-b8cd-e26bc882707b None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:58.901876 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01077c-171d-4c10-934f-958cced94c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:58.902260 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacce70-7332-49d4-b8cd-e26bc882707b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:58.902629 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacce70-7332-49d4-b8cd-e26bc882707b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:58.902850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01077c-171d-4c10-934f-958cced94c4c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:58.903190 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01077c-171d-4c10-934f-958cced94c4c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:58.903524 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01077c-171d-4c10-934f-958cced94c4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:58.904245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacce70-7332-49d4-b8cd-e26bc882707b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:58.911359 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01077c-171d-4c10-934f-958cced94c4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:58.912887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01077c-171d-4c10-934f-958cced94c4c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:58.915532 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:58.921570 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 318/631] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:58.921570 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacce70-7332-49d4-b8cd-e26bc882707b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-2e01077c-171d-4c10-934f-958cced94c4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:58.928939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:58.930027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:58.935701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:58.935701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:58.935701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:58.935701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:58.935701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:58.935701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:58.935701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:58.935701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:58.935701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 314/632] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:58.935701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01077c-171d-4c10-934f-958cced94c4c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:58.969951 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:59.026097 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacce70-7332-49d4-b8cd-e26bc882707b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:59.026948 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01077c-171d-4c10-934f-958cced94c4c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:59.059161 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639f306-469a-4bcd-82c2-8eb34dc60bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:59.059553 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987d17-aaf6-4e50-9770-34447bfeb186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:59.059805 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639f306-469a-4bcd-82c2-8eb34dc60bd5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.060082 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639f306-469a-4bcd-82c2-8eb34dc60bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.060329 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987d17-aaf6-4e50-9770-34447bfeb186 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.060422 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639f306-469a-4bcd-82c2-8eb34dc60bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.060611 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987d17-aaf6-4e50-9770-34447bfeb186 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.060884 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987d17-aaf6-4e50-9770-34447bfeb186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.061104 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639f306-469a-4bcd-82c2-8eb34dc60bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:59.061445 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639f306-469a-4bcd-82c2-8eb34dc60bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:59.063383 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639f306-469a-4bcd-82c2-8eb34dc60bd5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:59.068214 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b987d17-aaf6-4e50-9770-34447bfeb186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:59.069672 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b987d17-aaf6-4e50-9770-34447bfeb186 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:59.074993 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 319/633] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:59.076195 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e55a-c2d5-4c03-90d9-cd7f24ac2f6e None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.076477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e55a-c2d5-4c03-90d9-cd7f24ac2f6e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.076749 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8e55a-c2d5-4c03-90d9-cd7f24ac2f6e None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.078701 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 320/634] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:42:59.079220 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8e55a-c2d5-4c03-90d9-cd7f24ac2f6e None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-3b987d17-aaf6-4e50-9770-34447bfeb186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:42:59.091170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:59.092237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:59.093919 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:42:59.093919 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:42:59.093919 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:42:59.093919 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:42:59.093919 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:42:59.093919 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:42:59.093919 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:42:59.093919 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:59.093919 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 315/635] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:59.094590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987d17-aaf6-4e50-9770-34447bfeb186 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:59.153252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:59.180655 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:59.184631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8e55a-c2d5-4c03-90d9-cd7f24ac2f6e None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:59.196011 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987d17-aaf6-4e50-9770-34447bfeb186 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:59.217180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4689dd9-84d6-48f4-ad6f-5cb8e2a26ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:59.218428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689dd9-84d6-48f4-ad6f-5cb8e2a26ced None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.218707 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689dd9-84d6-48f4-ad6f-5cb8e2a26ced None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.218984 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4689dd9-84d6-48f4-ad6f-5cb8e2a26ced None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.219751 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4689dd9-84d6-48f4-ad6f-5cb8e2a26ced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:59.220062 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4689dd9-84d6-48f4-ad6f-5cb8e2a26ced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:59.221500 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4689dd9-84d6-48f4-ad6f-5cb8e2a26ced None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:59.228969 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8e8c5-e182-43ec-baa1-9c1fe0fd97bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:59.229642 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8e8c5-e182-43ec-baa1-9c1fe0fd97bd None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.229923 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8e8c5-e182-43ec-baa1-9c1fe0fd97bd None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.230196 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8e8c5-e182-43ec-baa1-9c1fe0fd97bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.231009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8e8c5-e182-43ec-baa1-9c1fe0fd97bd None admin] RBAC: Adding query filter params (role.id=5d30b117c7cb45a6ae69d3f19986213d, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=86c0b548be2d4948bca2817337fdee5f) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:59.231315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8e8c5-e182-43ec-baa1-9c1fe0fd97bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:59.232706 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8e8c5-e182-43ec-baa1-9c1fe0fd97bd None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:59.232798 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 321/636] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:59.234552 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d133d-1cbf-4d6f-b4c0-859204e318c9 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.234838 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d133d-1cbf-4d6f-b4c0-859204e318c9 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.235114 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d133d-1cbf-4d6f-b4c0-859204e318c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.242745 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 316/637] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:59 2022] GET /identity/v3/role_assignments?user.id=86c0b548be2d4948bca2817337fdee5f&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=5d30b117c7cb45a6ae69d3f19986213d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:59.243529 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8e8c5-e182-43ec-baa1-9c1fe0fd97bd None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:59.258139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-587d133d-1cbf-4d6f-b4c0-859204e318c9 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:42:59.259364 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-587d133d-1cbf-4d6f-b4c0-859204e318c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:42:59.337834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 322/638] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:42:59.339103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d133d-1cbf-4d6f-b4c0-859204e318c9 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:59.370481 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8e8c5-e182-43ec-baa1-9c1fe0fd97bd None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:59.396409 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:59.409118 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99c7ca-725a-43da-b47e-2b888777f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:59.409928 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99c7ca-725a-43da-b47e-2b888777f02f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.410264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99c7ca-725a-43da-b47e-2b888777f02f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.410608 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99c7ca-725a-43da-b47e-2b888777f02f None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.411461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99c7ca-725a-43da-b47e-2b888777f02f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:59.412365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99c7ca-725a-43da-b47e-2b888777f02f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:59.413332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99c7ca-725a-43da-b47e-2b888777f02f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:59.431921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 317/639] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:59.432090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99c7ca-725a-43da-b47e-2b888777f02f None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:59.462591 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:59.473766 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d133d-1cbf-4d6f-b4c0-859204e318c9 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:59.511615 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34ce0b-1fd6-4aa2-91e9-417a802adfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:59.512547 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34ce0b-1fd6-4aa2-91e9-417a802adfa4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.512989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34ce0b-1fd6-4aa2-91e9-417a802adfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.513453 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34ce0b-1fd6-4aa2-91e9-417a802adfa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.514428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34ce0b-1fd6-4aa2-91e9-417a802adfa4 None admin] RBAC: Adding query filter params (role.id=5d30b117c7cb45a6ae69d3f19986213d, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=b296e5ba36b243009b5fcfe708506c00) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:59.515272 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34ce0b-1fd6-4aa2-91e9-417a802adfa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:59.516724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34ce0b-1fd6-4aa2-91e9-417a802adfa4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:59.523824 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 323/640] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:59 2022] GET /identity/v3/role_assignments?user.id=b296e5ba36b243009b5fcfe708506c00&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=5d30b117c7cb45a6ae69d3f19986213d => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:59.524884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34ce0b-1fd6-4aa2-91e9-417a802adfa4 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:59.542434 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99c7ca-725a-43da-b47e-2b888777f02f None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:59.589450 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8195e7-bb50-4418-ba42-82f2f0bbb44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:59.590998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8195e7-bb50-4418-ba42-82f2f0bbb44e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.592063 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8195e7-bb50-4418-ba42-82f2f0bbb44e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.592539 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8195e7-bb50-4418-ba42-82f2f0bbb44e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.609827 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8195e7-bb50-4418-ba42-82f2f0bbb44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-1c8195e7-bb50-4418-ba42-82f2f0bbb44e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:42:59.622404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:42:59.624399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:42:59.626702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:42:59.633702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 318/641] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:42:59.635770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8195e7-bb50-4418-ba42-82f2f0bbb44e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:59.669765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34ce0b-1fd6-4aa2-91e9-417a802adfa4 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:59.704094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:59.708641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764377c-e07b-4238-9f38-9d5622db1595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:59.709327 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764377c-e07b-4238-9f38-9d5622db1595 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.709614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764377c-e07b-4238-9f38-9d5622db1595 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.709890 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764377c-e07b-4238-9f38-9d5622db1595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.710714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764377c-e07b-4238-9f38-9d5622db1595 None admin] RBAC: Adding query filter params (role.id=5d30b117c7cb45a6ae69d3f19986213d, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=a60cee165d0f46ef8078a91f03788410) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:59.711025 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764377c-e07b-4238-9f38-9d5622db1595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:59.712509 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764377c-e07b-4238-9f38-9d5622db1595 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:59.720010 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 324/642] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:42:59 2022] GET /identity/v3/role_assignments?user.id=a60cee165d0f46ef8078a91f03788410&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=5d30b117c7cb45a6ae69d3f19986213d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:59.773633 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8195e7-bb50-4418-ba42-82f2f0bbb44e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:59.816082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279e7ce-72c3-4a4e-b95a-a4c56410cf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:59.816763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279e7ce-72c3-4a4e-b95a-a4c56410cf49 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.817045 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279e7ce-72c3-4a4e-b95a-a4c56410cf49 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.817346 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279e7ce-72c3-4a4e-b95a-a4c56410cf49 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:42:59.818115 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279e7ce-72c3-4a4e-b95a-a4c56410cf49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:42:59.818420 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279e7ce-72c3-4a4e-b95a-a4c56410cf49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:42:59.819838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279e7ce-72c3-4a4e-b95a-a4c56410cf49 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:42:59.830315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 319/643] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:42:59.835521 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764377c-e07b-4238-9f38-9d5622db1595 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:42:59.857235 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:59.956168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764377c-e07b-4238-9f38-9d5622db1595 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:42:59.990813 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc1aee-a4f1-4942-9b2e-a24d54cdbcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:42:59.991609 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1aee-a4f1-4942-9b2e-a24d54cdbcfb None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:42:59.991890 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1aee-a4f1-4942-9b2e-a24d54cdbcfb None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:42:59.992165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1aee-a4f1-4942-9b2e-a24d54cdbcfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:00.003808 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc1aee-a4f1-4942-9b2e-a24d54cdbcfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:00.005362 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc1aee-a4f1-4942-9b2e-a24d54cdbcfb None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-f8bc1aee-a4f1-4942-9b2e-a24d54cdbcfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:43:00.023275 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:00.024360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:00.025473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:43:00.025473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:43:00.025473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:00.025473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:00.025473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 325/644] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:00.031332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279e7ce-72c3-4a4e-b95a-a4c56410cf49 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:00.138549 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279e7ce-72c3-4a4e-b95a-a4c56410cf49 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:00.146207 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:00.173817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4f45e-a93a-4acc-99c0-36cb4a55e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:00.174475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4f45e-a93a-4acc-99c0-36cb4a55e6fc None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:00.174756 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4f45e-a93a-4acc-99c0-36cb4a55e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:00.175033 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4f45e-a93a-4acc-99c0-36cb4a55e6fc None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:00.175738 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4f45e-a93a-4acc-99c0-36cb4a55e6fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:00.176037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4f45e-a93a-4acc-99c0-36cb4a55e6fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:00.177416 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4f45e-a93a-4acc-99c0-36cb4a55e6fc None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:00.190129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 320/645] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:00.195204 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc1aee-a4f1-4942-9b2e-a24d54cdbcfb None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:00.267542 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:00.301456 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc1aee-a4f1-4942-9b2e-a24d54cdbcfb None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:00.341026 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ef8b2-5d43-4fc1-ada0-a2e88bbee61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:00.341888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef8b2-5d43-4fc1-ada0-a2e88bbee61b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:00.342171 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef8b2-5d43-4fc1-ada0-a2e88bbee61b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:00.342510 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef8b2-5d43-4fc1-ada0-a2e88bbee61b None admin] PATH_INFO: `/v3/users/nova` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:00.350791 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ef8b2-5d43-4fc1-ada0-a2e88bbee61b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:00.352293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ef8b2-5d43-4fc1-ada0-a2e88bbee61b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-c70ef8b2-5d43-4fc1-ada0-a2e88bbee61b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:43:00.368022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:00.369013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:00.370037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:00.370037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:00.370037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:43:00.370037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:43:00.370037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:43:00.370037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:43:00.370037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:43:00.370037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:43:00.370037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:43:00.370037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:00.372627 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 326/646] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Jul 12 18:43:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:00.382899 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4f45e-a93a-4acc-99c0-36cb4a55e6fc None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:00.486252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4f45e-a93a-4acc-99c0-36cb4a55e6fc None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:00.521013 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03055782-cea6-4162-8e20-b9a0368e3b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:00.521629 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03055782-cea6-4162-8e20-b9a0368e3b02 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:00.521913 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03055782-cea6-4162-8e20-b9a0368e3b02 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:00.522186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03055782-cea6-4162-8e20-b9a0368e3b02 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:00.523015 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03055782-cea6-4162-8e20-b9a0368e3b02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:00.523319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03055782-cea6-4162-8e20-b9a0368e3b02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:00.524746 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03055782-cea6-4162-8e20-b9a0368e3b02 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:00.543165 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 321/647] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Jul 12 18:43:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:00.549424 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ef8b2-5d43-4fc1-ada0-a2e88bbee61b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:00.650897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ef8b2-5d43-4fc1-ada0-a2e88bbee61b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:00.685592 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa0f47-c7d7-4fff-b93b-4f1a136ed226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:00.686461 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:00.686930 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0f47-c7d7-4fff-b93b-4f1a136ed226 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:00.687459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0f47-c7d7-4fff-b93b-4f1a136ed226 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:00.687912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa0f47-c7d7-4fff-b93b-4f1a136ed226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:00.757304 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa0f47-c7d7-4fff-b93b-4f1a136ed226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:00.759154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa0f47-c7d7-4fff-b93b-4f1a136ed226 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:00.862401 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 327/648] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:43:00.868322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03055782-cea6-4162-8e20-b9a0368e3b02 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:00.897997 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:00.974749 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03055782-cea6-4162-8e20-b9a0368e3b02 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:01.009061 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f458b3-d6ca-4720-90d7-5196e00240a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:01.009881 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f458b3-d6ca-4720-90d7-5196e00240a5 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:01.010160 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f458b3-d6ca-4720-90d7-5196e00240a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:01.010431 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f458b3-d6ca-4720-90d7-5196e00240a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:01.021429 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f458b3-d6ca-4720-90d7-5196e00240a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:01.022888 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f458b3-d6ca-4720-90d7-5196e00240a5 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-80f458b3-d6ca-4720-90d7-5196e00240a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:43:01.042922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:01.043894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:01.044770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:43:01.044770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:43:01.044770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:01.044770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:01.044770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 322/649] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:01.050679 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa0f47-c7d7-4fff-b93b-4f1a136ed226 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:01.081810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:01.153909 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa0f47-c7d7-4fff-b93b-4f1a136ed226 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:01.189081 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9f7e8-f012-4a82-aff1-71643f7b7066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:01.189819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f7e8-f012-4a82-aff1-71643f7b7066 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:01.190101 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f7e8-f012-4a82-aff1-71643f7b7066 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:01.190428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f7e8-f012-4a82-aff1-71643f7b7066 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:01.191149 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9f7e8-f012-4a82-aff1-71643f7b7066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:01.191463 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9f7e8-f012-4a82-aff1-71643f7b7066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:01.192814 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9f7e8-f012-4a82-aff1-71643f7b7066 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:01.205003 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 328/650] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:01.210819 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f458b3-d6ca-4720-90d7-5196e00240a5 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:01.294059 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:01.317095 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f458b3-d6ca-4720-90d7-5196e00240a5 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:01.352017 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5edb8e-e496-493c-a6f8-273f000b3fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:01.352804 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5edb8e-e496-493c-a6f8-273f000b3fea None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:01.353084 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5edb8e-e496-493c-a6f8-273f000b3fea None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:01.353389 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5edb8e-e496-493c-a6f8-273f000b3fea None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:01.360856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5edb8e-e496-493c-a6f8-273f000b3fea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:01.362305 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5edb8e-e496-493c-a6f8-273f000b3fea None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-da5edb8e-e496-493c-a6f8-273f000b3fea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:43:01.376435 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:01.378411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:01.380134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:43:01.380134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:43:01.380134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:43:01.380134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:43:01.380134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:43:01.380134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:43:01.380134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:43:01.380134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:01.380134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 323/651] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:01.388123 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9f7e8-f012-4a82-aff1-71643f7b7066 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:01.489236 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:01.499145 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9f7e8-f012-4a82-aff1-71643f7b7066 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:01.534933 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048bcf8-eed0-4c3f-ac67-8a8024a0700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:01.535614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048bcf8-eed0-4c3f-ac67-8a8024a0700d None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:01.535899 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048bcf8-eed0-4c3f-ac67-8a8024a0700d None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:01.536203 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048bcf8-eed0-4c3f-ac67-8a8024a0700d None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:01.536960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048bcf8-eed0-4c3f-ac67-8a8024a0700d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:01.537272 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048bcf8-eed0-4c3f-ac67-8a8024a0700d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:01.538746 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048bcf8-eed0-4c3f-ac67-8a8024a0700d None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:01.552492 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 329/652] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:01.558381 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5edb8e-e496-493c-a6f8-273f000b3fea None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:01.592478 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb79ff-af2b-4892-aaca-10fc38137734 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:01.593367 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb79ff-af2b-4892-aaca-10fc38137734 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:01.593618 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb79ff-af2b-4892-aaca-10fc38137734 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:01.595111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 330/653] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:43:01.600161 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f5462-4a1c-4a8d-846e-23d9c10c78d0 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:01.600527 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f5462-4a1c-4a8d-846e-23d9c10c78d0 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:01.600716 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f5462-4a1c-4a8d-846e-23d9c10c78d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:01.623292 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-133f5462-4a1c-4a8d-846e-23d9c10c78d0 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:01.624785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-133f5462-4a1c-4a8d-846e-23d9c10c78d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:01.691909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5edb8e-e496-493c-a6f8-273f000b3fea None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:01.712764 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 331/654] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:43:01.739823 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ecfb-9ca5-4b8c-bf1d-624b09e45d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:01.740893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ecfb-9ca5-4b8c-bf1d-624b09e45d14 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:01.741700 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ecfb-9ca5-4b8c-bf1d-624b09e45d14 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:01.741989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0ecfb-9ca5-4b8c-bf1d-624b09e45d14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:01.742571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f5462-4a1c-4a8d-846e-23d9c10c78d0 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:01.742850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ecfb-9ca5-4b8c-bf1d-624b09e45d14 None admin] RBAC: Adding query filter params (role.id=948b82ff28c547e78755c196cddfdd0e, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=72918f9adc4240d99640b419e013b343) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:01.743173 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ecfb-9ca5-4b8c-bf1d-624b09e45d14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:01.744641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0ecfb-9ca5-4b8c-bf1d-624b09e45d14 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:01.749496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:01.752878 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 324/655] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:43:01 2022] GET /identity/v3/role_assignments?user.id=72918f9adc4240d99640b419e013b343&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=948b82ff28c547e78755c196cddfdd0e => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:01.857677 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:01.881712 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f5462-4a1c-4a8d-846e-23d9c10c78d0 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:01.921491 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609866d-fe35-4683-b775-f2b6cd8b3fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:01.922476 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609866d-fe35-4683-b775-f2b6cd8b3fb4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:01.922767 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609866d-fe35-4683-b775-f2b6cd8b3fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:01.923045 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609866d-fe35-4683-b775-f2b6cd8b3fb4 None admin] PATH_INFO: `/v3/services/image` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:01.923714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609866d-fe35-4683-b775-f2b6cd8b3fb4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:01.925227 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609866d-fe35-4683-b775-f2b6cd8b3fb4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-7609866d-fe35-4683-b775-f2b6cd8b3fb4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:01.940714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:01.941882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:01.942728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 332/656] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Jul 12 18:43:01 2022] GET /identity/v3/services/image => generated 86 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:01.948200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ecfb-9ca5-4b8c-bf1d-624b09e45d14 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:01.967480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0003d0d-58bb-4f1f-8613-8b45b03eaaeb None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:01.968039 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0003d0d-58bb-4f1f-8613-8b45b03eaaeb None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:01.968467 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0003d0d-58bb-4f1f-8613-8b45b03eaaeb None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:01.970388 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 333/657] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:01.975335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9c95-4a61-4dde-aabf-ebe0fbadafea None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:01.975794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9c95-4a61-4dde-aabf-ebe0fbadafea None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:01.976216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9c95-4a61-4dde-aabf-ebe0fbadafea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:01.993950 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-966c9c95-4a61-4dde-aabf-ebe0fbadafea None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:01.995388 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-966c9c95-4a61-4dde-aabf-ebe0fbadafea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:02.073351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 334/658] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:43:02.092032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0ecfb-9ca5-4b8c-bf1d-624b09e45d14 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:02.099464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c9c95-4a61-4dde-aabf-ebe0fbadafea None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:02.132939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a78f2-ada1-48a1-aea4-c0860a511e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:02.133634 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a78f2-ada1-48a1-aea4-c0860a511e76 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:02.133920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a78f2-ada1-48a1-aea4-c0860a511e76 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:02.134243 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a78f2-ada1-48a1-aea4-c0860a511e76 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:02.134996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a78f2-ada1-48a1-aea4-c0860a511e76 None admin] RBAC: Adding query filter params (name=image) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:02.135305 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a78f2-ada1-48a1-aea4-c0860a511e76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:02.136765 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a78f2-ada1-48a1-aea4-c0860a511e76 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:02.142341 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 325/659] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:02.147474 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a78f2-ada1-48a1-aea4-c0860a511e76 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:02.187788 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:02.218374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c9c95-4a61-4dde-aabf-ebe0fbadafea None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:02.235243 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:02.254081 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b3247-64c8-4a4e-a4b4-7d361193b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:02.254890 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b3247-64c8-4a4e-a4b4-7d361193b837 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:02.255179 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b3247-64c8-4a4e-a4b4-7d361193b837 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:02.255461 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b3247-64c8-4a4e-a4b4-7d361193b837 None admin] PATH_INFO: `/v3/services/network` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:02.256140 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b3247-64c8-4a4e-a4b4-7d361193b837 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:02.257526 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b3247-64c8-4a4e-a4b4-7d361193b837 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-430b3247-64c8-4a4e-a4b4-7d361193b837 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:02.269792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:02.270782 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:02.271612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 335/660] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:43:02 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:02.272386 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8dfc1-099a-41b2-a8eb-6c366f77e741 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:02.272976 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8dfc1-099a-41b2-a8eb-6c366f77e741 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:02.272976 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8dfc1-099a-41b2-a8eb-6c366f77e741 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:02.274245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 336/661] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:02.279531 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3a599-7ed1-43ce-beea-e3a503848e5a None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:02.279820 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3a599-7ed1-43ce-beea-e3a503848e5a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:02.280101 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3a599-7ed1-43ce-beea-e3a503848e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:02.284829 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a78f2-ada1-48a1-aea4-c0860a511e76 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:02.302314 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-81e3a599-7ed1-43ce-beea-e3a503848e5a None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:02.304154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-81e3a599-7ed1-43ce-beea-e3a503848e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:02.320683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89f9e2-1e98-409b-95e2-6e0a3e3a161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:02.321404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89f9e2-1e98-409b-95e2-6e0a3e3a161e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:02.321695 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89f9e2-1e98-409b-95e2-6e0a3e3a161e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:02.321977 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89f9e2-1e98-409b-95e2-6e0a3e3a161e None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:02.322681 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89f9e2-1e98-409b-95e2-6e0a3e3a161e None admin] RBAC: Adding query filter params (type=image) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:02.322993 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89f9e2-1e98-409b-95e2-6e0a3e3a161e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:02.324352 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89f9e2-1e98-409b-95e2-6e0a3e3a161e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:02.330648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 326/662] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:02.339014 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89f9e2-1e98-409b-95e2-6e0a3e3a161e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:02.403023 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 337/663] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:43:02.433156 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3a599-7ed1-43ce-beea-e3a503848e5a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:02.465736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89f9e2-1e98-409b-95e2-6e0a3e3a161e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:02.502622 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:02.512441 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:02.519741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0e829-ac0f-43c8-be1d-e809765fad9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:02.520427 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0e829-ac0f-43c8-be1d-e809765fad9c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:02.520713 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0e829-ac0f-43c8-be1d-e809765fad9c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:02.520989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0e829-ac0f-43c8-be1d-e809765fad9c None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:02.521731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0e829-ac0f-43c8-be1d-e809765fad9c None admin] RBAC: Adding query filter params (name=network) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:02.523467 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0e829-ac0f-43c8-be1d-e809765fad9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:02.523657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0e829-ac0f-43c8-be1d-e809765fad9c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:02.528648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 327/664] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:02.536183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0e829-ac0f-43c8-be1d-e809765fad9c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:02.558859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3a599-7ed1-43ce-beea-e3a503848e5a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:02.603658 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599ce9d-7ece-4b2e-8cca-cfea3d401ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:02.604530 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599ce9d-7ece-4b2e-8cca-cfea3d401ff1 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:02.604741 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599ce9d-7ece-4b2e-8cca-cfea3d401ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:02.605016 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599ce9d-7ece-4b2e-8cca-cfea3d401ff1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:02.605699 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599ce9d-7ece-4b2e-8cca-cfea3d401ff1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:02.607053 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599ce9d-7ece-4b2e-8cca-cfea3d401ff1 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-a599ce9d-7ece-4b2e-8cca-cfea3d401ff1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:02.620631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:02.621803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:02.622825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 338/665] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Jul 12 18:43:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:43:02.628235 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599ce9d-7ece-4b2e-8cca-cfea3d401ff1 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:02.664017 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0e829-ac0f-43c8-be1d-e809765fad9c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:02.704106 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a1e4-f6e6-489d-bd90-cbd525dfd631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:02.705038 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a1e4-f6e6-489d-bd90-cbd525dfd631 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:02.705498 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a1e4-f6e6-489d-bd90-cbd525dfd631 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:02.705936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5a1e4-f6e6-489d-bd90-cbd525dfd631 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:02.706809 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a1e4-f6e6-489d-bd90-cbd525dfd631 None admin] RBAC: Adding query filter params (type=network) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:02.707258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a1e4-f6e6-489d-bd90-cbd525dfd631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:02.708793 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5a1e4-f6e6-489d-bd90-cbd525dfd631 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:02.714949 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 328/666] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:02.878255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599ce9d-7ece-4b2e-8cca-cfea3d401ff1 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:02.914277 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:02.920356 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9011c-6854-4c6e-a2ed-83ebb61f8db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:02.921770 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9011c-6854-4c6e-a2ed-83ebb61f8db9 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:02.922237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9011c-6854-4c6e-a2ed-83ebb61f8db9 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:02.922507 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9011c-6854-4c6e-a2ed-83ebb61f8db9 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:02.923215 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9011c-6854-4c6e-a2ed-83ebb61f8db9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:02.923514 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9011c-6854-4c6e-a2ed-83ebb61f8db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:02.924866 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9011c-6854-4c6e-a2ed-83ebb61f8db9 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:02.930325 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 339/667] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Jul 12 18:43:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:02.935460 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a1e4-f6e6-489d-bd90-cbd525dfd631 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:02.997459 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:03.044562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5a1e4-f6e6-489d-bd90-cbd525dfd631 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:03.080104 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252670f6-eb89-4214-b1f8-c8bf5f64c90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:03.080778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252670f6-eb89-4214-b1f8-c8bf5f64c90b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:03.081064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252670f6-eb89-4214-b1f8-c8bf5f64c90b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:03.081414 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252670f6-eb89-4214-b1f8-c8bf5f64c90b None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:03.082121 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252670f6-eb89-4214-b1f8-c8bf5f64c90b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:03.082432 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252670f6-eb89-4214-b1f8-c8bf5f64c90b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:03.083811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252670f6-eb89-4214-b1f8-c8bf5f64c90b None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:03.088854 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 329/668] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Jul 12 18:43:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:04.093401 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022fa70-6634-4d9f-8413-c54a75dac459 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:04.094354 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022fa70-6634-4d9f-8413-c54a75dac459 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:04.094841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022fa70-6634-4d9f-8413-c54a75dac459 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:04.096621 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 340/669] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:04.102246 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216d7f-5c09-4282-9c77-b632fbb3eb3d None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:04.103064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216d7f-5c09-4282-9c77-b632fbb3eb3d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:04.103540 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216d7f-5c09-4282-9c77-b632fbb3eb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:04.123407 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-d5216d7f-5c09-4282-9c77-b632fbb3eb3d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:04.125543 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-d5216d7f-5c09-4282-9c77-b632fbb3eb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:04.194461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 330/670] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:43:04.218067 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022fa70-6634-4d9f-8413-c54a75dac459 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:04.329069 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022fa70-6634-4d9f-8413-c54a75dac459 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:04.365409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db3ac2-c717-4920-9454-2254332dad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:04.366198 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db3ac2-c717-4920-9454-2254332dad8a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:04.366476 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db3ac2-c717-4920-9454-2254332dad8a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:04.366754 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db3ac2-c717-4920-9454-2254332dad8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:04.378326 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db3ac2-c717-4920-9454-2254332dad8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-10db3ac2-c717-4920-9454-2254332dad8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:43:04.386102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:04.387048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:04.387889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 341/671] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:43:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:04.395168 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5216d7f-5c09-4282-9c77-b632fbb3eb3d None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:04.445993 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:04.503989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5216d7f-5c09-4282-9c77-b632fbb3eb3d None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:04.539132 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9fd1c-3137-458c-a0a3-eea73109100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:04.539799 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9fd1c-3137-458c-a0a3-eea73109100b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:04.540081 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9fd1c-3137-458c-a0a3-eea73109100b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:04.540360 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c9fd1c-3137-458c-a0a3-eea73109100b None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:04.541098 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9fd1c-3137-458c-a0a3-eea73109100b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:04.541434 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9fd1c-3137-458c-a0a3-eea73109100b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:04.542807 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c9fd1c-3137-458c-a0a3-eea73109100b None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:04.553335 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 331/672] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:43:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:04.559601 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db3ac2-c717-4920-9454-2254332dad8a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:04.622604 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:04.670465 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db3ac2-c717-4920-9454-2254332dad8a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:04.707057 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ed5ce-a853-42ad-bbc5-4841cd4252fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:04.708209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ed5ce-a853-42ad-bbc5-4841cd4252fc None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:04.708719 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ed5ce-a853-42ad-bbc5-4841cd4252fc None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:04.709206 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ed5ce-a853-42ad-bbc5-4841cd4252fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:04.720496 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ed5ce-a853-42ad-bbc5-4841cd4252fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:04.722202 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ed5ce-a853-42ad-bbc5-4841cd4252fc None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-412ed5ce-a853-42ad-bbc5-4841cd4252fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:43:04.740253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:04.741212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:04.742132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:43:04.742132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:43:04.742132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:04.742132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:04.744340 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 342/673] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:04.750814 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9fd1c-3137-458c-a0a3-eea73109100b None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:04.795218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f5af9-f6e2-4996-957c-2da524ad0727 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:04.795218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f5af9-f6e2-4996-957c-2da524ad0727 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:04.795218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f5af9-f6e2-4996-957c-2da524ad0727 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:04.795218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 343/674] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:04.798378 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ce9b2-6d06-43b9-97e0-dc71e2509f5d None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:04.798667 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ce9b2-6d06-43b9-97e0-dc71e2509f5d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:04.798946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ce9b2-6d06-43b9-97e0-dc71e2509f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:04.816611 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-030ce9b2-6d06-43b9-97e0-dc71e2509f5d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:04.817850 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-030ce9b2-6d06-43b9-97e0-dc71e2509f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:04.857506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c9fd1c-3137-458c-a0a3-eea73109100b None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:04.875939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:04.893500 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 344/675] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:43:04.896769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf01100-d48b-4ae2-815b-09de02fd78fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:04.897542 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf01100-d48b-4ae2-815b-09de02fd78fc None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:04.897827 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf01100-d48b-4ae2-815b-09de02fd78fc None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:04.898101 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf01100-d48b-4ae2-815b-09de02fd78fc None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:04.898902 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf01100-d48b-4ae2-815b-09de02fd78fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:04.899208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf01100-d48b-4ae2-815b-09de02fd78fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:04.900618 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf01100-d48b-4ae2-815b-09de02fd78fc None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:04.914159 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ce9b2-6d06-43b9-97e0-dc71e2509f5d None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:04.923886 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 332/676] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:04.928581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf01100-d48b-4ae2-815b-09de02fd78fc None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:04.966904 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:05.042060 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ce9b2-6d06-43b9-97e0-dc71e2509f5d None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:05.051165 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf01100-d48b-4ae2-815b-09de02fd78fc None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:05.083992 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e36b6-2115-47d5-898d-0e7522419f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:05.084656 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e36b6-2115-47d5-898d-0e7522419f89 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.084941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e36b6-2115-47d5-898d-0e7522419f89 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.085498 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e36b6-2115-47d5-898d-0e7522419f89 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.086020 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e36b6-2115-47d5-898d-0e7522419f89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:05.087382 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e36b6-2115-47d5-898d-0e7522419f89 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:05.093930 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669c12-c129-444c-a99f-2d2339777602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:05.095064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669c12-c129-444c-a99f-2d2339777602 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.095064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669c12-c129-444c-a99f-2d2339777602 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.095382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad669c12-c129-444c-a99f-2d2339777602 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.103193 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 345/677] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Jul 12 18:43:04 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:43:05.104453 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8cf81-d16c-4207-b51b-c2fc2151cdb0 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.104738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8cf81-d16c-4207-b51b-c2fc2151cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.105005 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8cf81-d16c-4207-b51b-c2fc2151cdb0 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.106414 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 346/678] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:05.107989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad669c12-c129-444c-a99f-2d2339777602 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:05.109534 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad669c12-c129-444c-a99f-2d2339777602 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:05.111697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205d8f-54d4-4c5b-aa3b-de50598a80ec None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.111984 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205d8f-54d4-4c5b-aa3b-de50598a80ec None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.112262 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32205d8f-54d4-4c5b-aa3b-de50598a80ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-ad669c12-c129-444c-a99f-2d2339777602 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:43:05.131064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:05.132137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:05.133137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:05.133137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:05.133137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:43:05.133137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:43:05.133137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:43:05.133137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:43:05.133137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:43:05.133137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:43:05.133137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:43:05.133137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:05.136897 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 333/679] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Jul 12 18:43:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:43:05.138265 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-32205d8f-54d4-4c5b-aa3b-de50598a80ec None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:05.138558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669c12-c129-444c-a99f-2d2339777602 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:05.140590 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-32205d8f-54d4-4c5b-aa3b-de50598a80ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:05.175675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:05.237480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 347/680] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:05 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:43:05.263974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32205d8f-54d4-4c5b-aa3b-de50598a80ec None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:05.278798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad669c12-c129-444c-a99f-2d2339777602 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:05.294666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:05.325105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bb5ec-7325-4228-aad6-0a1738581623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:05.326464 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bb5ec-7325-4228-aad6-0a1738581623 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.326897 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bb5ec-7325-4228-aad6-0a1738581623 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.328171 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bb5ec-7325-4228-aad6-0a1738581623 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.329331 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bb5ec-7325-4228-aad6-0a1738581623 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:05.330128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bb5ec-7325-4228-aad6-0a1738581623 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:05.332061 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bb5ec-7325-4228-aad6-0a1738581623 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:05.354428 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 334/681] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Jul 12 18:43:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:05.360307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bb5ec-7325-4228-aad6-0a1738581623 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:05.395820 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32205d8f-54d4-4c5b-aa3b-de50598a80ec None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:05.438178 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9149a-98ec-4e2c-ab56-5db3f2435a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:05.438859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9149a-98ec-4e2c-ab56-5db3f2435a90 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.439132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9149a-98ec-4e2c-ab56-5db3f2435a90 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.439409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9149a-98ec-4e2c-ab56-5db3f2435a90 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.440124 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9149a-98ec-4e2c-ab56-5db3f2435a90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:05.441515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9149a-98ec-4e2c-ab56-5db3f2435a90 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:05.456133 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 348/682] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Jul 12 18:43:05 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:43:05.457643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df721c-15d7-4e63-80cc-c232214b91ae None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.458056 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df721c-15d7-4e63-80cc-c232214b91ae None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.458406 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df721c-15d7-4e63-80cc-c232214b91ae None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.460168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 349/683] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:05.465845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:05.473830 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41acc5-cf94-4f86-aee2-c94dc2f881fb None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.474198 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41acc5-cf94-4f86-aee2-c94dc2f881fb None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.474566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41acc5-cf94-4f86-aee2-c94dc2f881fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.480098 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bb5ec-7325-4228-aad6-0a1738581623 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:05.494652 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-6f41acc5-cf94-4f86-aee2-c94dc2f881fb None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:05.495910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-6f41acc5-cf94-4f86-aee2-c94dc2f881fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:05.528044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1eec-dd06-48c8-9d45-c2de33d8d390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:05.529199 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1eec-dd06-48c8-9d45-c2de33d8d390 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.529694 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1eec-dd06-48c8-9d45-c2de33d8d390 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.530178 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce1eec-dd06-48c8-9d45-c2de33d8d390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.542746 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce1eec-dd06-48c8-9d45-c2de33d8d390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:05.544508 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbce1eec-dd06-48c8-9d45-c2de33d8d390 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-cbce1eec-dd06-48c8-9d45-c2de33d8d390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:43:05.566043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:05.566989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:05.567874 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:43:05.567874 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:43:05.567874 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:05.567874 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:05.573554 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 335/684] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:43:05.576009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1eec-dd06-48c8-9d45-c2de33d8d390 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:05.587180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 350/685] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:05 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:43:05.607999 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41acc5-cf94-4f86-aee2-c94dc2f881fb None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:05.629865 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:05.685535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbce1eec-dd06-48c8-9d45-c2de33d8d390 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:05.732272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb02123-26cb-402e-957c-4e75fc94f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:05.732962 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02123-26cb-402e-957c-4e75fc94f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.733823 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02123-26cb-402e-957c-4e75fc94f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.734102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb02123-26cb-402e-957c-4e75fc94f6a7 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.734820 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb02123-26cb-402e-957c-4e75fc94f6a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:05.735125 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb02123-26cb-402e-957c-4e75fc94f6a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:05.735248 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41acc5-cf94-4f86-aee2-c94dc2f881fb None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:05.736486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb02123-26cb-402e-957c-4e75fc94f6a7 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:05.747942 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:05.755019 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 336/686] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:05.760844 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb02123-26cb-402e-957c-4e75fc94f6a7 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:05.776152 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4964dc-18f8-4b53-bd6a-0200c1beba64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:05.776923 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4964dc-18f8-4b53-bd6a-0200c1beba64 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.777199 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4964dc-18f8-4b53-bd6a-0200c1beba64 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.777502 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4964dc-18f8-4b53-bd6a-0200c1beba64 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.778222 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4964dc-18f8-4b53-bd6a-0200c1beba64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:05.779696 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4964dc-18f8-4b53-bd6a-0200c1beba64 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:05.800664 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 351/687] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Jul 12 18:43:05 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:43:05.888580 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb02123-26cb-402e-957c-4e75fc94f6a7 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:05.940166 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1c185-b0b8-4e44-a0b0-571ca629d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:05.940969 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c185-b0b8-4e44-a0b0-571ca629d988 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:05.941248 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c185-b0b8-4e44-a0b0-571ca629d988 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:05.941555 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1c185-b0b8-4e44-a0b0-571ca629d988 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:05.949520 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1c185-b0b8-4e44-a0b0-571ca629d988 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:05.950989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1c185-b0b8-4e44-a0b0-571ca629d988 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-f2f1c185-b0b8-4e44-a0b0-571ca629d988 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:43:05.966562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:05.968090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:05.968996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:43:05.968996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:43:05.968996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:43:05.968996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:43:05.968996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:43:05.968996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:43:05.968996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:43:05.968996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:05.968996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 337/688] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:05.975645 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4964dc-18f8-4b53-bd6a-0200c1beba64 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:06.058143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:06.089951 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4964dc-18f8-4b53-bd6a-0200c1beba64 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:06.125682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de103906-bcc1-454c-b09c-2792a0c21bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:06.126647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103906-bcc1-454c-b09c-2792a0c21bd5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:06.126784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103906-bcc1-454c-b09c-2792a0c21bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:06.127163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de103906-bcc1-454c-b09c-2792a0c21bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:06.127892 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de103906-bcc1-454c-b09c-2792a0c21bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:06.128429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de103906-bcc1-454c-b09c-2792a0c21bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:06.130634 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de103906-bcc1-454c-b09c-2792a0c21bd5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:06.145772 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 352/689] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:06.151639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1c185-b0b8-4e44-a0b0-571ca629d988 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:06.210828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:06.263328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1c185-b0b8-4e44-a0b0-571ca629d988 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:06.299397 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d486d61-3496-441c-be26-537d83f29191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:06.300290 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d486d61-3496-441c-be26-537d83f29191 None admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:06.300569 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d486d61-3496-441c-be26-537d83f29191 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:06.300843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d486d61-3496-441c-be26-537d83f29191 None admin] PATH_INFO: `/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/72918f9adc4240d99640b419e013b343/roles/948b82ff28c547e78755c196cddfdd0e` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:06.302927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d486d61-3496-441c-be26-537d83f29191 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae279b6ea9b04682832e4f2aaf4f9a00, user_id=72918f9adc4240d99640b419e013b343, role_id=948b82ff28c547e78755c196cddfdd0e)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:06.304362 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d486d61-3496-441c-be26-537d83f29191 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:06.320587 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 338/690] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:43:06 2022] PUT /identity/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/72918f9adc4240d99640b419e013b343/roles/948b82ff28c547e78755c196cddfdd0e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:43:07.515813 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476dd89-622e-4cca-892a-6008501027b9 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:07.516381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476dd89-622e-4cca-892a-6008501027b9 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:07.516657 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476dd89-622e-4cca-892a-6008501027b9 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:07.518594 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 353/691] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:07.524179 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785ca6c-a2eb-4d9c-8343-d71ab653cdb3 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:07.524622 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785ca6c-a2eb-4d9c-8343-d71ab653cdb3 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:07.524729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785ca6c-a2eb-4d9c-8343-d71ab653cdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:07.543210 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-6785ca6c-a2eb-4d9c-8343-d71ab653cdb3 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:07.544432 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-6785ca6c-a2eb-4d9c-8343-d71ab653cdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:07.618710 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 339/692] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:07 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:07.642182 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476dd89-622e-4cca-892a-6008501027b9 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:07.750759 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476dd89-622e-4cca-892a-6008501027b9 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:07.786738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c56c19e-141a-447d-834d-914c48fb1350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:07.787445 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56c19e-141a-447d-834d-914c48fb1350 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:07.787724 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56c19e-141a-447d-834d-914c48fb1350 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:07.788001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c56c19e-141a-447d-834d-914c48fb1350 None admin] PATH_INFO: `/v3/services/image` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:07.788646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56c19e-141a-447d-834d-914c48fb1350 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:07.790032 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c56c19e-141a-447d-834d-914c48fb1350 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:07.791838 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-6c56c19e-141a-447d-834d-914c48fb1350 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:07.802181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:07.804296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:07.805816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 354/693] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Jul 12 18:43:07 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:07.810269 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785ca6c-a2eb-4d9c-8343-d71ab653cdb3 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:07.857126 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:07.877567 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f6a3-9dec-42c7-9e18-3e78cbb7232c None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:07.877899 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f6a3-9dec-42c7-9e18-3e78cbb7232c None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:07.878119 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9f6a3-9dec-42c7-9e18-3e78cbb7232c None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:07.880749 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 355/694] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:07.885995 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2390567-e8ac-4fec-a2f6-77fabd53a87c None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:07.886289 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2390567-e8ac-4fec-a2f6-77fabd53a87c None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:07.886572 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2390567-e8ac-4fec-a2f6-77fabd53a87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:07.912371 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-a2390567-e8ac-4fec-a2f6-77fabd53a87c None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:07.914119 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-a2390567-e8ac-4fec-a2f6-77fabd53a87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:07.917726 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785ca6c-a2eb-4d9c-8343-d71ab653cdb3 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:07.955499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af93fd8-1985-4a22-a7ff-6b4c22a620b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:07.956107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af93fd8-1985-4a22-a7ff-6b4c22a620b9 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:07.956507 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af93fd8-1985-4a22-a7ff-6b4c22a620b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:07.956784 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af93fd8-1985-4a22-a7ff-6b4c22a620b9 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:07.957516 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af93fd8-1985-4a22-a7ff-6b4c22a620b9 None admin] RBAC: Adding query filter params (name=image) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:07.957817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af93fd8-1985-4a22-a7ff-6b4c22a620b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:07.959399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af93fd8-1985-4a22-a7ff-6b4c22a620b9 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:07.964621 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 340/695] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:07.970364 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af93fd8-1985-4a22-a7ff-6b4c22a620b9 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:07.999545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 356/696] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:07 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:08.023484 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2390567-e8ac-4fec-a2f6-77fabd53a87c None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:08.087877 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af93fd8-1985-4a22-a7ff-6b4c22a620b9 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:08.098641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:08.126256 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f29aa-4e5a-46fe-88aa-294aff648ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:08.126923 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f29aa-4e5a-46fe-88aa-294aff648ef0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.127207 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f29aa-4e5a-46fe-88aa-294aff648ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.127490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f29aa-4e5a-46fe-88aa-294aff648ef0 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.128289 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f29aa-4e5a-46fe-88aa-294aff648ef0 None admin] RBAC: Adding query filter params (type=image) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:08.128593 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f29aa-4e5a-46fe-88aa-294aff648ef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:08.130083 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f29aa-4e5a-46fe-88aa-294aff648ef0 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:08.135737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 341/697] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:08.138733 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2390567-e8ac-4fec-a2f6-77fabd53a87c None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:08.142177 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f29aa-4e5a-46fe-88aa-294aff648ef0 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:08.169222 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:08.180943 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a84fdf-131f-446d-88d0-18c008b6cfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:08.181823 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84fdf-131f-446d-88d0-18c008b6cfc6 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.182052 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84fdf-131f-446d-88d0-18c008b6cfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.182333 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a84fdf-131f-446d-88d0-18c008b6cfc6 None admin] PATH_INFO: `/v3/services/network` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.182988 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a84fdf-131f-446d-88d0-18c008b6cfc6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:08.184358 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a84fdf-131f-446d-88d0-18c008b6cfc6 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-78a84fdf-131f-446d-88d0-18c008b6cfc6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:08.197245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:08.198303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:43:08.199175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:08.203490 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 357/698] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:43:08 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:43:08.204904 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a84fdf-131f-446d-88d0-18c008b6cfc6 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:08.260965 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f29aa-4e5a-46fe-88aa-294aff648ef0 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:08.299484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0797eea-6ce9-4c56-ba22-5030fef3833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:08.300147 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0797eea-6ce9-4c56-ba22-5030fef3833d None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.300428 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0797eea-6ce9-4c56-ba22-5030fef3833d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.300701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0797eea-6ce9-4c56-ba22-5030fef3833d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.301511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0797eea-6ce9-4c56-ba22-5030fef3833d None admin] RBAC: Adding query filter params (interface=public, service_id=68fbd2e1aaeb482a88ecbcf8f50a27d0, region_id=RegionOne) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:08.301820 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0797eea-6ce9-4c56-ba22-5030fef3833d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:08.303182 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0797eea-6ce9-4c56-ba22-5030fef3833d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:08.310779 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 342/699] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Jul 12 18:43:08 2022] GET /identity/v3/endpoints?service_id=68fbd2e1aaeb482a88ecbcf8f50a27d0&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:08.310779 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe438-3343-448f-bef9-12018b0a3a8c None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.310779 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe438-3343-448f-bef9-12018b0a3a8c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.310779 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fe438-3343-448f-bef9-12018b0a3a8c None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.310779 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 343/700] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:08.316560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a84fdf-131f-446d-88d0-18c008b6cfc6 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:08.318824 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fe438-3343-448f-bef9-12018b0a3a8c None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:08.354892 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:08.357418 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a896c83-d504-4e36-ac9e-820e16eb1a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:08.358800 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896c83-d504-4e36-ac9e-820e16eb1a6b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.359220 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896c83-d504-4e36-ac9e-820e16eb1a6b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.359632 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a896c83-d504-4e36-ac9e-820e16eb1a6b None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.360473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a896c83-d504-4e36-ac9e-820e16eb1a6b None admin] RBAC: Adding query filter params (name=network) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:08.360770 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a896c83-d504-4e36-ac9e-820e16eb1a6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:08.362132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a896c83-d504-4e36-ac9e-820e16eb1a6b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:08.371410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 358/701] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:08.371410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab21f6-8455-4487-8793-c49e411bbe47 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.371410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab21f6-8455-4487-8793-c49e411bbe47 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.371410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab21f6-8455-4487-8793-c49e411bbe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.386013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-d2ab21f6-8455-4487-8793-c49e411bbe47 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:08.387182 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-d2ab21f6-8455-4487-8793-c49e411bbe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:08.428427 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fe438-3343-448f-bef9-12018b0a3a8c None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:08.444778 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:08.473314 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 359/702] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:08 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:08.473314 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab21f6-8455-4487-8793-c49e411bbe47 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:08.476643 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66721c-5766-4526-867f-36d1fe4d68dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:08.477407 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66721c-5766-4526-867f-36d1fe4d68dc None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.477759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66721c-5766-4526-867f-36d1fe4d68dc None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.478104 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66721c-5766-4526-867f-36d1fe4d68dc None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.478853 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66721c-5766-4526-867f-36d1fe4d68dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:08.480273 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66721c-5766-4526-867f-36d1fe4d68dc None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:08.497527 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 344/703] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Jul 12 18:43:08 2022] GET /identity/v3/services => generated 1002 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:43:08.498507 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66721c-5766-4526-867f-36d1fe4d68dc None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:08.595021 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab21f6-8455-4487-8793-c49e411bbe47 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:08.638289 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0c5c7-b658-4f02-bf68-b55b6887e0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:08.639258 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c5c7-b658-4f02-bf68-b55b6887e0e8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.640296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c5c7-b658-4f02-bf68-b55b6887e0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.640778 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0c5c7-b658-4f02-bf68-b55b6887e0e8 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.641727 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0c5c7-b658-4f02-bf68-b55b6887e0e8 None admin] RBAC: Adding query filter params (type=network) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:08.642324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0c5c7-b658-4f02-bf68-b55b6887e0e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:08.643941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0c5c7-b658-4f02-bf68-b55b6887e0e8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:08.656462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:08.657254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 360/704] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:08.659322 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0c5c7-b658-4f02-bf68-b55b6887e0e8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:08.660489 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66721c-5766-4526-867f-36d1fe4d68dc None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:08.704130 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021d4cd-bcac-4c68-9ed7-3c77417aa0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:08.704950 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021d4cd-bcac-4c68-9ed7-3c77417aa0f5 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.705233 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021d4cd-bcac-4c68-9ed7-3c77417aa0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.705664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021d4cd-bcac-4c68-9ed7-3c77417aa0f5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.706772 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021d4cd-bcac-4c68-9ed7-3c77417aa0f5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:08.708551 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021d4cd-bcac-4c68-9ed7-3c77417aa0f5 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:08.716592 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-d021d4cd-bcac-4c68-9ed7-3c77417aa0f5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:08.723907 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:08.724856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:08.725753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 345/705] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Jul 12 18:43:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:08.727492 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0c614-3b3e-49a3-9b40-50987ce1a39a None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.727492 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0c614-3b3e-49a3-9b40-50987ce1a39a None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.727492 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0c614-3b3e-49a3-9b40-50987ce1a39a None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.728770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 346/706] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:08.733523 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0c614-3b3e-49a3-9b40-50987ce1a39a None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:08.787769 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0c5c7-b658-4f02-bf68-b55b6887e0e8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:08.826044 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddd210-7832-47f4-92e5-d8c775e8db31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:08.826701 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddd210-7832-47f4-92e5-d8c775e8db31 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.827048 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddd210-7832-47f4-92e5-d8c775e8db31 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.827839 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddd210-7832-47f4-92e5-d8c775e8db31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.828627 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddd210-7832-47f4-92e5-d8c775e8db31 None admin] RBAC: Adding query filter params (interface=public, service_id=4712a42df6634789af82fd38f86e83ca, region_id=RegionOne) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:08.828940 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddd210-7832-47f4-92e5-d8c775e8db31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:08.830344 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddd210-7832-47f4-92e5-d8c775e8db31 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:08.838072 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 361/707] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Jul 12 18:43:08 2022] GET /identity/v3/endpoints?service_id=4712a42df6634789af82fd38f86e83ca&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:08.843905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13fbe-bd23-4af6-a911-a82ef6a3de5b None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.844200 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13fbe-bd23-4af6-a911-a82ef6a3de5b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.844481 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13fbe-bd23-4af6-a911-a82ef6a3de5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.848302 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0c614-3b3e-49a3-9b40-50987ce1a39a None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:08.866695 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-a3d13fbe-bd23-4af6-a911-a82ef6a3de5b None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:08.868000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-a3d13fbe-bd23-4af6-a911-a82ef6a3de5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:08.887597 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b210b-0c4b-4d12-bd4b-9a49cf88c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:08.888267 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b210b-0c4b-4d12-bd4b-9a49cf88c6fb None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:08.888610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b210b-0c4b-4d12-bd4b-9a49cf88c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:08.888830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b210b-0c4b-4d12-bd4b-9a49cf88c6fb None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:08.890126 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b210b-0c4b-4d12-bd4b-9a49cf88c6fb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:08.890436 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b210b-0c4b-4d12-bd4b-9a49cf88c6fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:08.891825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464b210b-0c4b-4d12-bd4b-9a49cf88c6fb None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:08.896794 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 347/708] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Jul 12 18:43:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:08.897619 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b210b-0c4b-4d12-bd4b-9a49cf88c6fb None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:08.930799 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:08.960178 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 362/709] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:08 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:08.966753 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d13fbe-bd23-4af6-a911-a82ef6a3de5b None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:09.004226 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b210b-0c4b-4d12-bd4b-9a49cf88c6fb None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:09.020066 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:09.040180 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48fb39-f7bf-497e-b8e4-f0f160c68590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:09.040849 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48fb39-f7bf-497e-b8e4-f0f160c68590 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:09.041134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48fb39-f7bf-497e-b8e4-f0f160c68590 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:09.041589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48fb39-f7bf-497e-b8e4-f0f160c68590 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:09.042752 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48fb39-f7bf-497e-b8e4-f0f160c68590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:09.043768 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48fb39-f7bf-497e-b8e4-f0f160c68590 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:09.057318 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 348/710] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Jul 12 18:43:08 2022] GET /identity/v3/services => generated 1002 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:43:09.057318 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48fb39-f7bf-497e-b8e4-f0f160c68590 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:09.086536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d13fbe-bd23-4af6-a911-a82ef6a3de5b None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:09.128319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f231eeb-c46b-4ef7-8f76-3eaf0c8a285b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:09.129116 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f231eeb-c46b-4ef7-8f76-3eaf0c8a285b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:09.129437 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f231eeb-c46b-4ef7-8f76-3eaf0c8a285b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:09.129726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f231eeb-c46b-4ef7-8f76-3eaf0c8a285b None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:09.130636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f231eeb-c46b-4ef7-8f76-3eaf0c8a285b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:09.130945 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f231eeb-c46b-4ef7-8f76-3eaf0c8a285b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:09.132355 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f231eeb-c46b-4ef7-8f76-3eaf0c8a285b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:09.141428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 363/711] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Jul 12 18:43:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:09.149151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f231eeb-c46b-4ef7-8f76-3eaf0c8a285b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:09.172995 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:09.185677 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48fb39-f7bf-497e-b8e4-f0f160c68590 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:09.231725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d4abd-feb2-4081-a08f-5ac96a925216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:09.232672 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4abd-feb2-4081-a08f-5ac96a925216 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:09.233895 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4abd-feb2-4081-a08f-5ac96a925216 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:09.234178 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d4abd-feb2-4081-a08f-5ac96a925216 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:09.249783 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d4abd-feb2-4081-a08f-5ac96a925216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-d69d4abd-feb2-4081-a08f-5ac96a925216 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:43:09.258870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:09.259850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:09.260741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 349/712] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:43:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:09.266622 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d4abd-feb2-4081-a08f-5ac96a925216 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:09.280057 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f231eeb-c46b-4ef7-8f76-3eaf0c8a285b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:09.291429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:09.326814 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de92f2-4dda-4420-8d21-9b1806057f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:09.327831 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de92f2-4dda-4420-8d21-9b1806057f2c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:09.328752 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de92f2-4dda-4420-8d21-9b1806057f2c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:09.329263 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de92f2-4dda-4420-8d21-9b1806057f2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:09.330554 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de92f2-4dda-4420-8d21-9b1806057f2c None admin] RBAC: Adding query filter params (interface=public, service_id=f8a4e141a26b4cf9a4be881a680af5f5, region_id=RegionOne) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:09.331228 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de92f2-4dda-4420-8d21-9b1806057f2c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:09.333429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de92f2-4dda-4420-8d21-9b1806057f2c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:09.344695 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 364/713] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Jul 12 18:43:09 2022] GET /identity/v3/endpoints?service_id=f8a4e141a26b4cf9a4be881a680af5f5&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:09.345963 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de92f2-4dda-4420-8d21-9b1806057f2c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:09.394813 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d4abd-feb2-4081-a08f-5ac96a925216 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:09.445434 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e634a-4444-4dad-b391-dc49d4597ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:09.446686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e634a-4444-4dad-b391-dc49d4597ed1 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:09.447416 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e634a-4444-4dad-b391-dc49d4597ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:09.448322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e634a-4444-4dad-b391-dc49d4597ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:09.449573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e634a-4444-4dad-b391-dc49d4597ed1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:09.450347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e634a-4444-4dad-b391-dc49d4597ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:09.452692 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e634a-4444-4dad-b391-dc49d4597ed1 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:09.453807 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de92f2-4dda-4420-8d21-9b1806057f2c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:09.464963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 350/714] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:43:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:09.470128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e634a-4444-4dad-b391-dc49d4597ed1 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:09.489673 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57296077-4825-491f-a64a-c232cd533a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:09.490337 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57296077-4825-491f-a64a-c232cd533a0b None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:09.490623 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57296077-4825-491f-a64a-c232cd533a0b None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:09.490901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57296077-4825-491f-a64a-c232cd533a0b None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:09.491590 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57296077-4825-491f-a64a-c232cd533a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:09.492952 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57296077-4825-491f-a64a-c232cd533a0b None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:09.493537 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:09.505590 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 365/715] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Jul 12 18:43:09 2022] GET /identity/v3/services => generated 1002 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:43:09.597592 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e634a-4444-4dad-b391-dc49d4597ed1 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:09.637643 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0231ab-a7eb-449c-b774-100e204c39d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:09.638451 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0231ab-a7eb-449c-b774-100e204c39d8 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:09.638794 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0231ab-a7eb-449c-b774-100e204c39d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:09.639069 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0231ab-a7eb-449c-b774-100e204c39d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:09.651676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0231ab-a7eb-449c-b774-100e204c39d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:09.653183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0231ab-a7eb-449c-b774-100e204c39d8 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-0b0231ab-a7eb-449c-b774-100e204c39d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:43:09.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:09.675286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:09.676552 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:43:09.676552 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:43:09.676552 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:09.676552 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:09.676552 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 351/716] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:43:09.682646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57296077-4825-491f-a64a-c232cd533a0b None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:09.721584 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:09.789721 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57296077-4825-491f-a64a-c232cd533a0b None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:09.826068 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47360ba-bb70-4e0e-9e40-92c3c1666fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:09.826814 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47360ba-bb70-4e0e-9e40-92c3c1666fbc None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:09.827103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47360ba-bb70-4e0e-9e40-92c3c1666fbc None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:09.827381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47360ba-bb70-4e0e-9e40-92c3c1666fbc None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:09.828101 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47360ba-bb70-4e0e-9e40-92c3c1666fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:09.828408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47360ba-bb70-4e0e-9e40-92c3c1666fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:09.829796 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47360ba-bb70-4e0e-9e40-92c3c1666fbc None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:09.841683 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 366/717] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:09.847909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0231ab-a7eb-449c-b774-100e204c39d8 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:09.917155 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:09.953860 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0231ab-a7eb-449c-b774-100e204c39d8 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:09.988834 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f003e7-644d-492e-9fe1-2685316075bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:09.989662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f003e7-644d-492e-9fe1-2685316075bf None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:09.989946 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f003e7-644d-492e-9fe1-2685316075bf None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:09.990228 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f003e7-644d-492e-9fe1-2685316075bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:09.997936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f003e7-644d-492e-9fe1-2685316075bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:09.999428 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f003e7-644d-492e-9fe1-2685316075bf None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-89f003e7-644d-492e-9fe1-2685316075bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:43:10.013515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:10.014990 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:10.015927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:10.015927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:10.015927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:43:10.015927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:43:10.015927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:43:10.015927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:43:10.015927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:43:10.015927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:43:10.015927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:43:10.015927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:10.017083 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 352/718] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Jul 12 18:43:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:10.021244 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47360ba-bb70-4e0e-9e40-92c3c1666fbc None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:10.122843 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:10.129016 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47360ba-bb70-4e0e-9e40-92c3c1666fbc None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:10.166147 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9fc59-5941-4302-8c67-8f06fc4487a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:10.166806 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fc59-5941-4302-8c67-8f06fc4487a4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:10.167086 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fc59-5941-4302-8c67-8f06fc4487a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:10.167417 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fc59-5941-4302-8c67-8f06fc4487a4 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:10.168178 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9fc59-5941-4302-8c67-8f06fc4487a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:10.168483 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9fc59-5941-4302-8c67-8f06fc4487a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:10.169915 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9fc59-5941-4302-8c67-8f06fc4487a4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:10.187969 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 367/719] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Jul 12 18:43:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:10.193664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f003e7-644d-492e-9fe1-2685316075bf None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:10.305886 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f003e7-644d-492e-9fe1-2685316075bf None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:10.333156 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:10.342325 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ec7d1-7087-4089-bb3f-2ba339ae4aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:10.343596 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec7d1-7087-4089-bb3f-2ba339ae4aa0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:10.343879 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec7d1-7087-4089-bb3f-2ba339ae4aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:10.344151 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec7d1-7087-4089-bb3f-2ba339ae4aa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:10.414663 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ec7d1-7087-4089-bb3f-2ba339ae4aa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:10.416112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ec7d1-7087-4089-bb3f-2ba339ae4aa0 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:10.529442 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 353/720] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:43:10 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:43:10.531896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9fc59-5941-4302-8c67-8f06fc4487a4 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:10.640991 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9fc59-5941-4302-8c67-8f06fc4487a4 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:10.678075 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c4c7a-1f0e-4f38-b256-8b9e393ffe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:10.678858 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c4c7a-1f0e-4f38-b256-8b9e393ffe0f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:10.679137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c4c7a-1f0e-4f38-b256-8b9e393ffe0f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:10.679413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c4c7a-1f0e-4f38-b256-8b9e393ffe0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:10.689962 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c4c7a-1f0e-4f38-b256-8b9e393ffe0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:10.691404 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c4c7a-1f0e-4f38-b256-8b9e393ffe0f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-eb0c4c7a-1f0e-4f38-b256-8b9e393ffe0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:43:10.711237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:10.712324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:10.713256 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:43:10.713256 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:43:10.713256 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:10.713256 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:10.713256 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 368/721] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:43:10.718960 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ec7d1-7087-4089-bb3f-2ba339ae4aa0 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:10.747156 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:10.829942 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ec7d1-7087-4089-bb3f-2ba339ae4aa0 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:10.869306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40d166-8412-435c-bcaf-7171c39d869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:10.869306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40d166-8412-435c-bcaf-7171c39d869a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:10.869306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40d166-8412-435c-bcaf-7171c39d869a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:10.869306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40d166-8412-435c-bcaf-7171c39d869a None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:10.869762 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40d166-8412-435c-bcaf-7171c39d869a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:10.869762 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40d166-8412-435c-bcaf-7171c39d869a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:10.869762 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40d166-8412-435c-bcaf-7171c39d869a None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:10.885576 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 354/722] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:10.890380 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c4c7a-1f0e-4f38-b256-8b9e393ffe0f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:10.903605 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:10.960856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867276ce-124d-4c00-a24b-8d3db6470660 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:10.961177 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867276ce-124d-4c00-a24b-8d3db6470660 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:10.961452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867276ce-124d-4c00-a24b-8d3db6470660 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:10.966686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 355/723] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:10.968170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57439871-e362-4b2b-bd07-f7779a5c850c None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:10.968457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57439871-e362-4b2b-bd07-f7779a5c850c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:10.968744 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57439871-e362-4b2b-bd07-f7779a5c850c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:10.986850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-57439871-e362-4b2b-bd07-f7779a5c850c None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:10.988059 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-57439871-e362-4b2b-bd07-f7779a5c850c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:11.004030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c4c7a-1f0e-4f38-b256-8b9e393ffe0f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:11.040651 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aee1aa-7bcd-494b-9947-b0ee7393d9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:11.041472 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee1aa-7bcd-494b-9947-b0ee7393d9e0 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.041754 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee1aa-7bcd-494b-9947-b0ee7393d9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.042028 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aee1aa-7bcd-494b-9947-b0ee7393d9e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.049797 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aee1aa-7bcd-494b-9947-b0ee7393d9e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:11.051428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aee1aa-7bcd-494b-9947-b0ee7393d9e0 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-20aee1aa-7bcd-494b-9947-b0ee7393d9e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:43:11.066459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:11.067397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:11.068312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:43:11.068312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:43:11.068312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:43:11.068312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:43:11.068312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:43:11.068312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:43:11.068312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:43:11.068312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:11.068312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 369/725] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:11.068833 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 356/725] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:43:11.073363 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aee1aa-7bcd-494b-9947-b0ee7393d9e0 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:11.087531 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57439871-e362-4b2b-bd07-f7779a5c850c None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:11.106203 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:11.145748 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:11.185441 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aee1aa-7bcd-494b-9947-b0ee7393d9e0 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:11.196564 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57439871-e362-4b2b-bd07-f7779a5c850c None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:11.222069 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dee2a-fb1c-45fd-bf0c-030270c747c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:11.222756 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dee2a-fb1c-45fd-bf0c-030270c747c4 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.223105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dee2a-fb1c-45fd-bf0c-030270c747c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.223382 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dee2a-fb1c-45fd-bf0c-030270c747c4 None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.224165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dee2a-fb1c-45fd-bf0c-030270c747c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:11.224473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dee2a-fb1c-45fd-bf0c-030270c747c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:11.226112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dee2a-fb1c-45fd-bf0c-030270c747c4 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:11.234961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa4a07-0391-4156-895d-65fd63870dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:11.235759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa4a07-0391-4156-895d-65fd63870dac None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.236089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa4a07-0391-4156-895d-65fd63870dac None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.236370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa4a07-0391-4156-895d-65fd63870dac None admin] PATH_INFO: `/v3/services/image` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.237069 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa4a07-0391-4156-895d-65fd63870dac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:11.238543 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa4a07-0391-4156-895d-65fd63870dac None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:11.244553 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 370/726] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:11.245487 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dee2a-fb1c-45fd-bf0c-030270c747c4 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-befa4a07-0391-4156-895d-65fd63870dac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:11.251279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:11.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:43:11.255660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:11.257576 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 357/727] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Jul 12 18:43:11 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:11.265316 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa4a07-0391-4156-895d-65fd63870dac None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:11.348693 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:11.359501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dee2a-fb1c-45fd-bf0c-030270c747c4 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:11.369393 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa4a07-0391-4156-895d-65fd63870dac None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:11.387809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:11.398795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34099019-2ae2-4c4b-b5a8-7ca40196e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:11.399545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099019-2ae2-4c4b-b5a8-7ca40196e94c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.399834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099019-2ae2-4c4b-b5a8-7ca40196e94c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.400205 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34099019-2ae2-4c4b-b5a8-7ca40196e94c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.401031 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34099019-2ae2-4c4b-b5a8-7ca40196e94c None admin] RBAC: Adding query filter params (role.id=948b82ff28c547e78755c196cddfdd0e, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=72918f9adc4240d99640b419e013b343) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:11.401379 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34099019-2ae2-4c4b-b5a8-7ca40196e94c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:11.402992 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34099019-2ae2-4c4b-b5a8-7ca40196e94c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:11.405892 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa175a-fe54-4836-96ee-e6c1dfc33d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:11.406644 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa175a-fe54-4836-96ee-e6c1dfc33d8a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.406987 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa175a-fe54-4836-96ee-e6c1dfc33d8a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.407327 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa175a-fe54-4836-96ee-e6c1dfc33d8a None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.408124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa175a-fe54-4836-96ee-e6c1dfc33d8a None admin] RBAC: Adding query filter params (name=image) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:11.408496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa175a-fe54-4836-96ee-e6c1dfc33d8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:11.409962 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa175a-fe54-4836-96ee-e6c1dfc33d8a None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:11.415186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 358/729] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:11.415597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 371/729] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:43:11 2022] GET /identity/v3/role_assignments?user.id=72918f9adc4240d99640b419e013b343&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=948b82ff28c547e78755c196cddfdd0e => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:11.427935 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa175a-fe54-4836-96ee-e6c1dfc33d8a None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:11.491862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266dd29-8001-477b-9f98-89f0172a725b None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.491862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266dd29-8001-477b-9f98-89f0172a725b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.491862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266dd29-8001-477b-9f98-89f0172a725b None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.492773 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 372/730] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:11.498679 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba15492-be27-4696-9d2c-276bf6e43442 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.499312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba15492-be27-4696-9d2c-276bf6e43442 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.499801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba15492-be27-4696-9d2c-276bf6e43442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.518165 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-dba15492-be27-4696-9d2c-276bf6e43442 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:11.519915 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-dba15492-be27-4696-9d2c-276bf6e43442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:11.540059 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa175a-fe54-4836-96ee-e6c1dfc33d8a None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:11.587657 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa48dd-32ed-4632-990d-a5291774d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:11.588334 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa48dd-32ed-4632-990d-a5291774d6ee None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.588612 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa48dd-32ed-4632-990d-a5291774d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.588884 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa48dd-32ed-4632-990d-a5291774d6ee None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.589658 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa48dd-32ed-4632-990d-a5291774d6ee None admin] RBAC: Adding query filter params (type=image) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:11.589960 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa48dd-32ed-4632-990d-a5291774d6ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:11.591356 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa48dd-32ed-4632-990d-a5291774d6ee None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:11.602511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 359/731] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:11.605427 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa48dd-32ed-4632-990d-a5291774d6ee None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:11.619346 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:11.624579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 373/732] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:11.652353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba15492-be27-4696-9d2c-276bf6e43442 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:11.727865 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa48dd-32ed-4632-990d-a5291774d6ee None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:11.763746 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc331-9d0a-4102-bd00-7e237649d789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:11.765115 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc331-9d0a-4102-bd00-7e237649d789 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.765506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc331-9d0a-4102-bd00-7e237649d789 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.765780 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc331-9d0a-4102-bd00-7e237649d789 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.766523 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dc331-9d0a-4102-bd00-7e237649d789 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:11.767895 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dc331-9d0a-4102-bd00-7e237649d789 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:11.784115 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba15492-be27-4696-9d2c-276bf6e43442 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:11.791768 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 360/733] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Jul 12 18:43:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:43:11.811037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:11.838620 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f57ef6-479b-4477-a73c-ae7a351739f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:11.839490 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f57ef6-479b-4477-a73c-ae7a351739f8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.839815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f57ef6-479b-4477-a73c-ae7a351739f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.840139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f57ef6-479b-4477-a73c-ae7a351739f8 None admin] PATH_INFO: `/v3/services/network` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.840796 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f57ef6-479b-4477-a73c-ae7a351739f8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:11.842594 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f57ef6-479b-4477-a73c-ae7a351739f8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:11.845512 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10122ced-3773-437b-a497-19c7786ef0b2 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.845804 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10122ced-3773-437b-a497-19c7786ef0b2 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.846086 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10122ced-3773-437b-a497-19c7786ef0b2 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.847776 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 361/734] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:11.853577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ff8fc-5518-4ae6-8130-be301a31c068 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:11.853770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ff8fc-5518-4ae6-8130-be301a31c068 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:11.854052 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ff8fc-5518-4ae6-8130-be301a31c068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-30f57ef6-479b-4477-a73c-ae7a351739f8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:11.856913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:11.857965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:11.860296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 374/735] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:43:11 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:11.864496 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f57ef6-479b-4477-a73c-ae7a351739f8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:11.894350 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-090ff8fc-5518-4ae6-8130-be301a31c068 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:11.896478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-090ff8fc-5518-4ae6-8130-be301a31c068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:11.990568 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:12.005817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 362/736] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:11 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:12.014184 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f57ef6-479b-4477-a73c-ae7a351739f8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:12.029319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ff8fc-5518-4ae6-8130-be301a31c068 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:12.052290 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e613e9-3dcd-4fdf-9608-6c9c3b190268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:12.053325 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e613e9-3dcd-4fdf-9608-6c9c3b190268 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:12.053813 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e613e9-3dcd-4fdf-9608-6c9c3b190268 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:12.054264 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e613e9-3dcd-4fdf-9608-6c9c3b190268 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:12.055302 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e613e9-3dcd-4fdf-9608-6c9c3b190268 None admin] RBAC: Adding query filter params (name=network) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:12.055786 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e613e9-3dcd-4fdf-9608-6c9c3b190268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:12.057414 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e613e9-3dcd-4fdf-9608-6c9c3b190268 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:12.068194 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 375/737] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:12.069785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e613e9-3dcd-4fdf-9608-6c9c3b190268 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:12.121963 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:12.158410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ff8fc-5518-4ae6-8130-be301a31c068 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:12.199974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e613e9-3dcd-4fdf-9608-6c9c3b190268 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:12.206045 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9e8bc-8eef-4031-9a26-3ee0ef9fcd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:12.206858 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9e8bc-8eef-4031-9a26-3ee0ef9fcd54 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:12.207141 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9e8bc-8eef-4031-9a26-3ee0ef9fcd54 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:12.207416 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9e8bc-8eef-4031-9a26-3ee0ef9fcd54 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:12.208073 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9e8bc-8eef-4031-9a26-3ee0ef9fcd54 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:12.209473 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9e8bc-8eef-4031-9a26-3ee0ef9fcd54 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-99f9e8bc-8eef-4031-9a26-3ee0ef9fcd54 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:12.224936 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:12.226201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:43:12.227200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:12.231355 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 363/738] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Jul 12 18:43:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:12.232257 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9e8bc-8eef-4031-9a26-3ee0ef9fcd54 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:12.246651 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8fea4-7595-4f58-aefd-257cbb304ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:12.247836 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8fea4-7595-4f58-aefd-257cbb304ed6 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:12.248291 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8fea4-7595-4f58-aefd-257cbb304ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:12.249587 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8fea4-7595-4f58-aefd-257cbb304ed6 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:12.250960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8fea4-7595-4f58-aefd-257cbb304ed6 None admin] RBAC: Adding query filter params (type=network) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:12.251696 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8fea4-7595-4f58-aefd-257cbb304ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:12.253504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8fea4-7595-4f58-aefd-257cbb304ed6 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:12.261160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 376/739] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:12.269379 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8fea4-7595-4f58-aefd-257cbb304ed6 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:12.303041 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:12.349631 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9e8bc-8eef-4031-9a26-3ee0ef9fcd54 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:12.387768 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36530e00-f7d6-4371-8208-c842e781d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:12.388463 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36530e00-f7d6-4371-8208-c842e781d3cd None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:12.388808 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36530e00-f7d6-4371-8208-c842e781d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:12.389150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36530e00-f7d6-4371-8208-c842e781d3cd None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:12.390242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36530e00-f7d6-4371-8208-c842e781d3cd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:12.390980 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36530e00-f7d6-4371-8208-c842e781d3cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:12.392427 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36530e00-f7d6-4371-8208-c842e781d3cd None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:12.401439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 364/740] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Jul 12 18:43:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:12.404423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36530e00-f7d6-4371-8208-c842e781d3cd None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:12.414203 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8fea4-7595-4f58-aefd-257cbb304ed6 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:12.426823 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:12.467008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd1496-9c6d-40c7-b25f-28339d904f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:12.468195 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1496-9c6d-40c7-b25f-28339d904f5c None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:12.468705 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1496-9c6d-40c7-b25f-28339d904f5c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:12.469216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd1496-9c6d-40c7-b25f-28339d904f5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:12.470367 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd1496-9c6d-40c7-b25f-28339d904f5c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:12.472063 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd1496-9c6d-40c7-b25f-28339d904f5c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:12.496074 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 377/741] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Jul 12 18:43:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:43:12.543906 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36530e00-f7d6-4371-8208-c842e781d3cd None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:12.570682 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:12.590445 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2235e-1ebb-4138-9e52-3b713c5647f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:12.591236 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2235e-1ebb-4138-9e52-3b713c5647f9 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:12.591521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2235e-1ebb-4138-9e52-3b713c5647f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:12.591799 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2235e-1ebb-4138-9e52-3b713c5647f9 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:12.594132 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2235e-1ebb-4138-9e52-3b713c5647f9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:12.594132 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2235e-1ebb-4138-9e52-3b713c5647f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:12.594796 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2235e-1ebb-4138-9e52-3b713c5647f9 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:12.600643 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 365/742] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Jul 12 18:43:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:12.606235 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd1496-9c6d-40c7-b25f-28339d904f5c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:12.729954 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd1496-9c6d-40c7-b25f-28339d904f5c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:12.767903 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77652fb-a4db-4d78-88e3-764e99b3138d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:12.768916 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77652fb-a4db-4d78-88e3-764e99b3138d None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:12.769435 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77652fb-a4db-4d78-88e3-764e99b3138d None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:12.769908 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77652fb-a4db-4d78-88e3-764e99b3138d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:12.770868 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77652fb-a4db-4d78-88e3-764e99b3138d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:12.772425 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77652fb-a4db-4d78-88e3-764e99b3138d None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:12.796751 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 378/743] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Jul 12 18:43:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:43:13.849785 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d1ecb-29a3-46b0-9fe4-1a52b09f4970 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:13.850348 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d1ecb-29a3-46b0-9fe4-1a52b09f4970 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:13.850647 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d1ecb-29a3-46b0-9fe4-1a52b09f4970 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:13.852877 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 366/744] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:13.858611 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b7ce0-3b64-44c4-b865-90933bd24287 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:13.859148 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b7ce0-3b64-44c4-b865-90933bd24287 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:13.859666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b7ce0-3b64-44c4-b865-90933bd24287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:13.881150 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-c23b7ce0-3b64-44c4-b865-90933bd24287 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:13.882661 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-c23b7ce0-3b64-44c4-b865-90933bd24287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:13.898307 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:13.959387 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 379/745] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:13 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:13.984058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d1ecb-29a3-46b0-9fe4-1a52b09f4970 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:14.090455 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d1ecb-29a3-46b0-9fe4-1a52b09f4970 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:14.123057 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e6366-9632-489a-b173-0d94a2b54a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:14.124312 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6366-9632-489a-b173-0d94a2b54a2e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:14.124594 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6366-9632-489a-b173-0d94a2b54a2e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:14.124864 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6366-9632-489a-b173-0d94a2b54a2e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:14.125537 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e6366-9632-489a-b173-0d94a2b54a2e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:14.126894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e6366-9632-489a-b173-0d94a2b54a2e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-834e6366-9632-489a-b173-0d94a2b54a2e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:14.139072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:14.140577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:43:14.141453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:14.145351 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 367/746] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Jul 12 18:43:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:14.145528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf775b15-7963-4ce7-bf5b-61506928691d None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:14.145709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf775b15-7963-4ce7-bf5b-61506928691d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:14.145987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf775b15-7963-4ce7-bf5b-61506928691d None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:14.146910 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e6366-9632-489a-b173-0d94a2b54a2e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:14.149396 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 380/747] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:14.152215 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1412fc3-0321-43aa-bd56-4220c7c5031b None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:14.152496 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1412fc3-0321-43aa-bd56-4220c7c5031b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:14.152772 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1412fc3-0321-43aa-bd56-4220c7c5031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:14.169896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-c1412fc3-0321-43aa-bd56-4220c7c5031b None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:14.171093 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-c1412fc3-0321-43aa-bd56-4220c7c5031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:14.202825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:14.245769 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 381/748] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:14 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:14.265586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e6366-9632-489a-b173-0d94a2b54a2e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:14.270404 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1412fc3-0321-43aa-bd56-4220c7c5031b None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:14.302621 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32cece-9da4-45dd-b8e5-74c8a31dc02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:14.303274 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32cece-9da4-45dd-b8e5-74c8a31dc02b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:14.303555 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32cece-9da4-45dd-b8e5-74c8a31dc02b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:14.303828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32cece-9da4-45dd-b8e5-74c8a31dc02b None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:14.304520 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32cece-9da4-45dd-b8e5-74c8a31dc02b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:14.304821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32cece-9da4-45dd-b8e5-74c8a31dc02b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:14.306206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db32cece-9da4-45dd-b8e5-74c8a31dc02b None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:14.310760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 368/749] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Jul 12 18:43:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:14.317543 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32cece-9da4-45dd-b8e5-74c8a31dc02b None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:14.352192 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:14.375481 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1412fc3-0321-43aa-bd56-4220c7c5031b None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:14.409992 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6cc9-826a-4779-8b9e-d622c5d72a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:14.410904 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6cc9-826a-4779-8b9e-d622c5d72a4e None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:14.411186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6cc9-826a-4779-8b9e-d622c5d72a4e None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:14.411621 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6cc9-826a-4779-8b9e-d622c5d72a4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:14.421991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32cece-9da4-45dd-b8e5-74c8a31dc02b None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:14.433835 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:14.460460 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb425ff-8e6f-44b2-9589-7fe5a79321d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:14.461440 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb425ff-8e6f-44b2-9589-7fe5a79321d2 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:14.461731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb425ff-8e6f-44b2-9589-7fe5a79321d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:14.462011 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb425ff-8e6f-44b2-9589-7fe5a79321d2 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:14.462889 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb425ff-8e6f-44b2-9589-7fe5a79321d2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:14.463572 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb425ff-8e6f-44b2-9589-7fe5a79321d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:14.464946 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb425ff-8e6f-44b2-9589-7fe5a79321d2 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:14.469592 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 369/750] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Jul 12 18:43:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:14.488720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6cc9-826a-4779-8b9e-d622c5d72a4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:14.491288 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6cc9-826a-4779-8b9e-d622c5d72a4e None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:14.578685 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:14.609323 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 382/751] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:43:14 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 18:43:14.610586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb425ff-8e6f-44b2-9589-7fe5a79321d2 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:14.714950 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb425ff-8e6f-44b2-9589-7fe5a79321d2 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:14.748128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276acdcf-f3fc-484e-b553-bee19d72abc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:14.749564 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276acdcf-f3fc-484e-b553-bee19d72abc6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:14.749894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276acdcf-f3fc-484e-b553-bee19d72abc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:14.750170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276acdcf-f3fc-484e-b553-bee19d72abc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:14.761964 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276acdcf-f3fc-484e-b553-bee19d72abc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:14.763401 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276acdcf-f3fc-484e-b553-bee19d72abc6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-276acdcf-f3fc-484e-b553-bee19d72abc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:43:14.781128 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:14.782043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:14.782944 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:43:14.782944 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:43:14.782944 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:43:14.782944 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:14.782944 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 370/752] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:14.789021 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6cc9-826a-4779-8b9e-d622c5d72a4e None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:14.892757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6cc9-826a-4779-8b9e-d622c5d72a4e None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:14.928969 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff3bc6-cbde-42d2-acb1-c40c0b009e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:14.929684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff3bc6-cbde-42d2-acb1-c40c0b009e69 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:14.929972 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff3bc6-cbde-42d2-acb1-c40c0b009e69 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:14.930243 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff3bc6-cbde-42d2-acb1-c40c0b009e69 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:14.930981 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff3bc6-cbde-42d2-acb1-c40c0b009e69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:14.931288 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff3bc6-cbde-42d2-acb1-c40c0b009e69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:14.932690 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff3bc6-cbde-42d2-acb1-c40c0b009e69 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:14.953315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 383/753] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:15.096886 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02004d5a-1caa-4908-9e7f-2bbeaf66e4be None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:15.097467 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02004d5a-1caa-4908-9e7f-2bbeaf66e4be None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:15.097467 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02004d5a-1caa-4908-9e7f-2bbeaf66e4be None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:15.099054 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 371/754] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:15.104342 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd260b0-3167-4e65-aca8-6fc19664766a None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:15.104637 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd260b0-3167-4e65-aca8-6fc19664766a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:15.104918 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd260b0-3167-4e65-aca8-6fc19664766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:15.122523 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-8bd260b0-3167-4e65-aca8-6fc19664766a None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:15.124059 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-8bd260b0-3167-4e65-aca8-6fc19664766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:15.155860 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:15.201192 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 384/755] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:15 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:15.225418 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02004d5a-1caa-4908-9e7f-2bbeaf66e4be None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:15.254125 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:15.328332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02004d5a-1caa-4908-9e7f-2bbeaf66e4be None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:15.360543 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30efd14-6e71-47b1-98b5-4886caeb443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:15.361266 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30efd14-6e71-47b1-98b5-4886caeb443c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:15.361575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30efd14-6e71-47b1-98b5-4886caeb443c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:15.361847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30efd14-6e71-47b1-98b5-4886caeb443c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:15.362495 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30efd14-6e71-47b1-98b5-4886caeb443c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:15.363858 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30efd14-6e71-47b1-98b5-4886caeb443c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-d30efd14-6e71-47b1-98b5-4886caeb443c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:15.375383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:15.376518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:15.377725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 372/756] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:43:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:15.382461 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd260b0-3167-4e65-aca8-6fc19664766a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:15.478136 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd260b0-3167-4e65-aca8-6fc19664766a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:15.509759 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093c4ef-d8b9-40b5-b72c-307b3acb3089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:15.510407 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c4ef-d8b9-40b5-b72c-307b3acb3089 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:15.510685 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c4ef-d8b9-40b5-b72c-307b3acb3089 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:15.510958 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093c4ef-d8b9-40b5-b72c-307b3acb3089 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:15.511643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093c4ef-d8b9-40b5-b72c-307b3acb3089 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:15.511945 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093c4ef-d8b9-40b5-b72c-307b3acb3089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:15.513301 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5093c4ef-d8b9-40b5-b72c-307b3acb3089 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:15.518242 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 385/757] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:43:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:15.523857 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30efd14-6e71-47b1-98b5-4886caeb443c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:15.732317 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:15.742188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30efd14-6e71-47b1-98b5-4886caeb443c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:15.775700 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e4c83-05cb-489e-818d-ea5db7b97361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:15.776355 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4c83-05cb-489e-818d-ea5db7b97361 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:15.776638 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4c83-05cb-489e-818d-ea5db7b97361 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:15.776911 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e4c83-05cb-489e-818d-ea5db7b97361 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:15.777639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e4c83-05cb-489e-818d-ea5db7b97361 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:15.777943 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e4c83-05cb-489e-818d-ea5db7b97361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:15.779306 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e4c83-05cb-489e-818d-ea5db7b97361 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:15.783961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 373/758] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:43:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:16.733963 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f3ff8-0311-4e3f-b263-fdbaa99a50cf None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:16.734489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f3ff8-0311-4e3f-b263-fdbaa99a50cf None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:16.734575 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f3ff8-0311-4e3f-b263-fdbaa99a50cf None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:16.735906 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 386/759] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:16.741078 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a603147-9a99-44e7-ae23-1393d9cb0c6e None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:16.741492 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a603147-9a99-44e7-ae23-1393d9cb0c6e None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:16.741792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a603147-9a99-44e7-ae23-1393d9cb0c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:16.758146 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-8a603147-9a99-44e7-ae23-1393d9cb0c6e None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:16.759315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-8a603147-9a99-44e7-ae23-1393d9cb0c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:16.823260 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 374/760] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:16 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:16.848008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f3ff8-0311-4e3f-b263-fdbaa99a50cf None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:16.881325 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:16.954842 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f3ff8-0311-4e3f-b263-fdbaa99a50cf None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:16.987529 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed38cb-b770-4c8d-abb6-3371acd85a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:16.988108 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed38cb-b770-4c8d-abb6-3371acd85a5f None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:16.988384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed38cb-b770-4c8d-abb6-3371acd85a5f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:16.988653 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed38cb-b770-4c8d-abb6-3371acd85a5f None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:16.989387 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed38cb-b770-4c8d-abb6-3371acd85a5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:16.990735 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ed38cb-b770-4c8d-abb6-3371acd85a5f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:17.003301 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 387/761] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Jul 12 18:43:16 2022] POST /identity/v3/services => generated 269 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:43:18.024029 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a58c3-7380-453b-84a9-9091f773a85c None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:18.024544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a58c3-7380-453b-84a9-9091f773a85c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:18.024631 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a58c3-7380-453b-84a9-9091f773a85c None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:18.025945 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 375/762] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:18.031930 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8df8f6-7e08-4d97-b106-d69aa6b25c98 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:18.032345 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8df8f6-7e08-4d97-b106-d69aa6b25c98 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:18.032489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8df8f6-7e08-4d97-b106-d69aa6b25c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:18.049368 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-dc8df8f6-7e08-4d97-b106-d69aa6b25c98 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:18.050545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-dc8df8f6-7e08-4d97-b106-d69aa6b25c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:18.120468 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 388/763] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:18 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:43:18.145102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a58c3-7380-453b-84a9-9091f773a85c None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:18.227679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:18.244009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a58c3-7380-453b-84a9-9091f773a85c None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:18.276402 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef8e4f-d144-4408-8e5b-29501f80b948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:18.277059 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8e4f-d144-4408-8e5b-29501f80b948 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:18.277368 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8e4f-d144-4408-8e5b-29501f80b948 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:18.277646 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef8e4f-d144-4408-8e5b-29501f80b948 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:18.278365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef8e4f-d144-4408-8e5b-29501f80b948 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:18.280294 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef8e4f-d144-4408-8e5b-29501f80b948 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:18.296975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 376/764] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Jul 12 18:43:18 2022] POST /identity/v3/services => generated 251 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:43:19.253433 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead587a-683f-4cd2-bc11-efd71a2945d6 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:19.253982 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead587a-683f-4cd2-bc11-efd71a2945d6 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:19.254069 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead587a-683f-4cd2-bc11-efd71a2945d6 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:19.255374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 389/765] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:19.260542 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b13b-6c36-4500-85a7-750bc1acb1a5 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:19.260933 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b13b-6c36-4500-85a7-750bc1acb1a5 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:19.261219 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806b13b-6c36-4500-85a7-750bc1acb1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:19.278082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-1806b13b-6c36-4500-85a7-750bc1acb1a5 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:19.279258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-1806b13b-6c36-4500-85a7-750bc1acb1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:19.349303 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 377/766] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:19 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:19.373268 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead587a-683f-4cd2-bc11-efd71a2945d6 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:19.392052 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:19.476089 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead587a-683f-4cd2-bc11-efd71a2945d6 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:19.519104 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a20aa-142b-4c12-a026-31f036c6c1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:19.519856 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a20aa-142b-4c12-a026-31f036c6c1bb None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:19.520134 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a20aa-142b-4c12-a026-31f036c6c1bb None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:19.520406 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a20aa-142b-4c12-a026-31f036c6c1bb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:19.521053 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a20aa-142b-4c12-a026-31f036c6c1bb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:19.522449 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a20aa-142b-4c12-a026-31f036c6c1bb None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-7d0a20aa-142b-4c12-a026-31f036c6c1bb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:19.534750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:19.535694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:19.536545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 390/767] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Jul 12 18:43:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:19.541972 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b13b-6c36-4500-85a7-750bc1acb1a5 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:19.606538 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:19.636457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806b13b-6c36-4500-85a7-750bc1acb1a5 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:19.668569 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc52eaf-a569-4278-93e7-32095cc4419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:19.669220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc52eaf-a569-4278-93e7-32095cc4419a None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:19.669527 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc52eaf-a569-4278-93e7-32095cc4419a None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:19.669802 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc52eaf-a569-4278-93e7-32095cc4419a None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:19.670991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc52eaf-a569-4278-93e7-32095cc4419a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:19.671288 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc52eaf-a569-4278-93e7-32095cc4419a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:19.672628 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc52eaf-a569-4278-93e7-32095cc4419a None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:19.677354 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 378/768] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Jul 12 18:43:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:19.682771 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a20aa-142b-4c12-a026-31f036c6c1bb None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:19.761054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:19.779873 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a20aa-142b-4c12-a026-31f036c6c1bb None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:19.812745 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465f299-9a32-41e0-bb15-722d40aa7da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:19.813429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465f299-9a32-41e0-bb15-722d40aa7da8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:19.813714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465f299-9a32-41e0-bb15-722d40aa7da8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:19.813994 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465f299-9a32-41e0-bb15-722d40aa7da8 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:19.814685 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465f299-9a32-41e0-bb15-722d40aa7da8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:19.814990 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465f299-9a32-41e0-bb15-722d40aa7da8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:19.816342 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465f299-9a32-41e0-bb15-722d40aa7da8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:19.821186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 391/769] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Jul 12 18:43:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:19.826934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc52eaf-a569-4278-93e7-32095cc4419a None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:19.928816 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc52eaf-a569-4278-93e7-32095cc4419a None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:19.965768 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99f64e-6b67-49e8-95be-913a2f694a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:19.966424 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f64e-6b67-49e8-95be-913a2f694a0f None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:19.966704 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f64e-6b67-49e8-95be-913a2f694a0f None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:19.966977 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99f64e-6b67-49e8-95be-913a2f694a0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:19.967754 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99f64e-6b67-49e8-95be-913a2f694a0f None admin] RBAC: Adding query filter params (interface=public, service_id=1b725327d83348e28fa9e6156e529ac2, region_id=RegionOne) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:19.968062 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99f64e-6b67-49e8-95be-913a2f694a0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:19.969446 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e99f64e-6b67-49e8-95be-913a2f694a0f None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:19.970908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:19.977456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 379/770] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Jul 12 18:43:19 2022] GET /identity/v3/endpoints?service_id=1b725327d83348e28fa9e6156e529ac2&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:19.980924 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465f299-9a32-41e0-bb15-722d40aa7da8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:20.079039 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465f299-9a32-41e0-bb15-722d40aa7da8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:20.111908 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab88046-c1e3-4025-a78e-177c76c8cb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:20.112561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab88046-c1e3-4025-a78e-177c76c8cb52 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:20.112840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab88046-c1e3-4025-a78e-177c76c8cb52 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:20.113113 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab88046-c1e3-4025-a78e-177c76c8cb52 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:20.113840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab88046-c1e3-4025-a78e-177c76c8cb52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:20.115167 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab88046-c1e3-4025-a78e-177c76c8cb52 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:20.120977 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 392/771] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Jul 12 18:43:19 2022] GET /identity/v3/services => generated 1498 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:43:20.559636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb7e1-f982-41dc-9b25-dcb163052cc4 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:20.560169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb7e1-f982-41dc-9b25-dcb163052cc4 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:20.560169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceb7e1-f982-41dc-9b25-dcb163052cc4 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:20.561665 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 380/772] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:20.566844 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0afae-83bc-413e-888f-724b531fc30d None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:20.567261 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0afae-83bc-413e-888f-724b531fc30d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:20.567392 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0afae-83bc-413e-888f-724b531fc30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:20.584074 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-a4b0afae-83bc-413e-888f-724b531fc30d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:20.585237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-a4b0afae-83bc-413e-888f-724b531fc30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:20.587208 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:20.650531 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 393/773] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:20 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:20.674806 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb7e1-f982-41dc-9b25-dcb163052cc4 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:20.774048 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceb7e1-f982-41dc-9b25-dcb163052cc4 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:20.807047 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587307a-0bf7-4444-92f0-b44b8b13f942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:20.807832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587307a-0bf7-4444-92f0-b44b8b13f942 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:20.808113 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587307a-0bf7-4444-92f0-b44b8b13f942 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:20.808388 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587307a-0bf7-4444-92f0-b44b8b13f942 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:20.809030 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587307a-0bf7-4444-92f0-b44b8b13f942 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:20.810469 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587307a-0bf7-4444-92f0-b44b8b13f942 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-e587307a-0bf7-4444-92f0-b44b8b13f942 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:20.822461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:20.823478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:20.824326 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 381/774] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:43:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:20.830127 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0afae-83bc-413e-888f-724b531fc30d None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:20.927953 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0afae-83bc-413e-888f-724b531fc30d None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:20.960800 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e2dc3-944e-46b4-842f-0a85024e3f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:20.961476 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e2dc3-944e-46b4-842f-0a85024e3f1a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:20.961757 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e2dc3-944e-46b4-842f-0a85024e3f1a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:20.962034 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e2dc3-944e-46b4-842f-0a85024e3f1a None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:20.962727 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e2dc3-944e-46b4-842f-0a85024e3f1a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:20.963033 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e2dc3-944e-46b4-842f-0a85024e3f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:20.964380 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e2dc3-944e-46b4-842f-0a85024e3f1a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:20.968961 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 394/775] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:43:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:20.974736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587307a-0bf7-4444-92f0-b44b8b13f942 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:21.033557 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:21.074460 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587307a-0bf7-4444-92f0-b44b8b13f942 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:21.106628 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af129-d4de-4bf4-869a-36dbadc531ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:21.107281 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af129-d4de-4bf4-869a-36dbadc531ef None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:21.107560 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af129-d4de-4bf4-869a-36dbadc531ef None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:21.107857 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289af129-d4de-4bf4-869a-36dbadc531ef None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:21.108551 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289af129-d4de-4bf4-869a-36dbadc531ef None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:21.108854 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289af129-d4de-4bf4-869a-36dbadc531ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:21.110236 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289af129-d4de-4bf4-869a-36dbadc531ef None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:21.115085 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 382/776] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:43:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:21.120814 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e2dc3-944e-46b4-842f-0a85024e3f1a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:21.124174 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:21.218701 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e2dc3-944e-46b4-842f-0a85024e3f1a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:21.253242 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee1225-2a42-48e1-b271-67849175a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:21.253926 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1225-2a42-48e1-b271-67849175a08a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:21.254212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1225-2a42-48e1-b271-67849175a08a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:21.254490 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee1225-2a42-48e1-b271-67849175a08a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:21.255279 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee1225-2a42-48e1-b271-67849175a08a None admin] RBAC: Adding query filter params (interface=public, service_id=63e83869f94441c8ba856700af94669e, region_id=RegionOne) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:21.255589 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee1225-2a42-48e1-b271-67849175a08a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:21.256987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee1225-2a42-48e1-b271-67849175a08a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:21.262122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 395/777] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Jul 12 18:43:21 2022] GET /identity/v3/endpoints?service_id=63e83869f94441c8ba856700af94669e&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:21.267614 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af129-d4de-4bf4-869a-36dbadc531ef None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:21.363732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289af129-d4de-4bf4-869a-36dbadc531ef None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:21.387686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:21.396341 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1be096-72ce-4560-a802-6b036230a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:21.396993 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be096-72ce-4560-a802-6b036230a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:21.397271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be096-72ce-4560-a802-6b036230a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:21.397565 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be096-72ce-4560-a802-6b036230a7b6 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:21.398232 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1be096-72ce-4560-a802-6b036230a7b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:21.399585 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1be096-72ce-4560-a802-6b036230a7b6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:21.405340 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 383/778] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Jul 12 18:43:21 2022] GET /identity/v3/services => generated 1498 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:43:22.351131 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f7cca-89b9-47c0-915a-5ef1b22d578a None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:22.351715 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f7cca-89b9-47c0-915a-5ef1b22d578a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:22.351715 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f7cca-89b9-47c0-915a-5ef1b22d578a None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:22.353110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 396/779] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:22.358383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b508e5-6a80-4b9d-8509-a9be734622fc None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:22.358782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b508e5-6a80-4b9d-8509-a9be734622fc None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:22.359051 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b508e5-6a80-4b9d-8509-a9be734622fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:22.375701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-d1b508e5-6a80-4b9d-8509-a9be734622fc None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:22.376859 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-d1b508e5-6a80-4b9d-8509-a9be734622fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:22.440940 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 384/780] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:22 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:22.465428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f7cca-89b9-47c0-915a-5ef1b22d578a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:22.529962 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:22.569304 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f7cca-89b9-47c0-915a-5ef1b22d578a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:22.601966 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2714f6b-4586-401e-847f-4202142ab58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:22.602689 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714f6b-4586-401e-847f-4202142ab58c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:22.602967 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714f6b-4586-401e-847f-4202142ab58c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:22.603239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714f6b-4586-401e-847f-4202142ab58c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:22.603874 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2714f6b-4586-401e-847f-4202142ab58c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:22.605221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2714f6b-4586-401e-847f-4202142ab58c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-e2714f6b-4586-401e-847f-4202142ab58c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:22.618100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:22.619310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:22.620480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 397/781] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Jul 12 18:43:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:22.625711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b508e5-6a80-4b9d-8509-a9be734622fc None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:22.721349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b508e5-6a80-4b9d-8509-a9be734622fc None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:22.741004 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:22.755414 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577230b6-40b0-4468-ad48-29cab407c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:22.756083 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577230b6-40b0-4468-ad48-29cab407c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:22.756370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577230b6-40b0-4468-ad48-29cab407c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:22.756647 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577230b6-40b0-4468-ad48-29cab407c2c2 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:22.757375 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577230b6-40b0-4468-ad48-29cab407c2c2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:22.757685 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577230b6-40b0-4468-ad48-29cab407c2c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:22.759049 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577230b6-40b0-4468-ad48-29cab407c2c2 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:22.763688 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 385/782] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Jul 12 18:43:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:22.771742 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2714f6b-4586-401e-847f-4202142ab58c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:22.868245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2714f6b-4586-401e-847f-4202142ab58c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:22.898974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:22.905175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe5dd6-799f-4e24-bd93-79503a612170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:22.906123 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe5dd6-799f-4e24-bd93-79503a612170 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:22.906402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe5dd6-799f-4e24-bd93-79503a612170 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:22.906674 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe5dd6-799f-4e24-bd93-79503a612170 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:22.907370 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe5dd6-799f-4e24-bd93-79503a612170 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:22.907674 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe5dd6-799f-4e24-bd93-79503a612170 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:22.909016 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe5dd6-799f-4e24-bd93-79503a612170 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:22.913988 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 398/783] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Jul 12 18:43:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:22.919387 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577230b6-40b0-4468-ad48-29cab407c2c2 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:23.014468 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577230b6-40b0-4468-ad48-29cab407c2c2 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:23.047621 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea23332-9b8e-4321-a17b-f96adb9061c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:23.048264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea23332-9b8e-4321-a17b-f96adb9061c1 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:23.048544 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea23332-9b8e-4321-a17b-f96adb9061c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:23.048819 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea23332-9b8e-4321-a17b-f96adb9061c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:23.049601 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea23332-9b8e-4321-a17b-f96adb9061c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:23.050963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea23332-9b8e-4321-a17b-f96adb9061c1 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:23.068699 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 386/784] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Jul 12 18:43:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:43:23.650137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e674f-34e7-4bee-a982-78b8d892202e None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:23.650703 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e674f-34e7-4bee-a982-78b8d892202e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:23.650703 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e674f-34e7-4bee-a982-78b8d892202e None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:23.652042 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 399/785] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:23.658048 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462a0f4-c86e-4ca9-b7d8-3e809a2f8bc1 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:23.658469 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462a0f4-c86e-4ca9-b7d8-3e809a2f8bc1 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:23.658601 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462a0f4-c86e-4ca9-b7d8-3e809a2f8bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:23.675419 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-b462a0f4-c86e-4ca9-b7d8-3e809a2f8bc1 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:23.676571 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-b462a0f4-c86e-4ca9-b7d8-3e809a2f8bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:23.709143 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:23.747199 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 387/786] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:23.771353 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e674f-34e7-4bee-a982-78b8d892202e None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:23.872586 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e674f-34e7-4bee-a982-78b8d892202e None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:23.907148 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b19fae-93e0-404d-8fac-b27a497d130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:23.907899 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b19fae-93e0-404d-8fac-b27a497d130a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:23.908177 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b19fae-93e0-404d-8fac-b27a497d130a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:23.908446 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b19fae-93e0-404d-8fac-b27a497d130a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:23.909085 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b19fae-93e0-404d-8fac-b27a497d130a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:23.910464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b19fae-93e0-404d-8fac-b27a497d130a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-c5b19fae-93e0-404d-8fac-b27a497d130a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:23.922144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:23.923196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:23.924047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 400/787] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:43:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:23.929225 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462a0f4-c86e-4ca9-b7d8-3e809a2f8bc1 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:24.024256 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462a0f4-c86e-4ca9-b7d8-3e809a2f8bc1 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:24.056384 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5969166-cf82-4bc8-8352-0122e897d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:24.057037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969166-cf82-4bc8-8352-0122e897d5f6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:24.057350 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969166-cf82-4bc8-8352-0122e897d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:24.057632 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5969166-cf82-4bc8-8352-0122e897d5f6 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:24.058336 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5969166-cf82-4bc8-8352-0122e897d5f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:24.058642 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5969166-cf82-4bc8-8352-0122e897d5f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:24.060004 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5969166-cf82-4bc8-8352-0122e897d5f6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:24.069745 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 388/788] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:43:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:24.070783 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b19fae-93e0-404d-8fac-b27a497d130a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:24.129807 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:24.178647 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b19fae-93e0-404d-8fac-b27a497d130a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:24.212981 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3256b-b3c5-40cc-93c4-9b8a15dbcfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:24.213678 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3256b-b3c5-40cc-93c4-9b8a15dbcfe2 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:24.213968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3256b-b3c5-40cc-93c4-9b8a15dbcfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:24.214241 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3256b-b3c5-40cc-93c4-9b8a15dbcfe2 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:24.214940 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3256b-b3c5-40cc-93c4-9b8a15dbcfe2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:24.215243 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3256b-b3c5-40cc-93c4-9b8a15dbcfe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:24.216597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3256b-b3c5-40cc-93c4-9b8a15dbcfe2 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:24.221547 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 401/789] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Jul 12 18:43:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:43:24.226978 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5969166-cf82-4bc8-8352-0122e897d5f6 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:24.258288 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:24.330762 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5969166-cf82-4bc8-8352-0122e897d5f6 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:24.366389 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179439b-8421-4aed-9965-07e88b6c5177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:24.367037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179439b-8421-4aed-9965-07e88b6c5177 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:24.367317 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179439b-8421-4aed-9965-07e88b6c5177 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:24.367592 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179439b-8421-4aed-9965-07e88b6c5177 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:24.368317 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179439b-8421-4aed-9965-07e88b6c5177 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:24.369720 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8179439b-8421-4aed-9965-07e88b6c5177 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:24.388160 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 389/790] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Jul 12 18:43:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:43:25.287162 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6449c-2257-4b5d-bf01-53eaf09cb370 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:25.287706 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6449c-2257-4b5d-bf01-53eaf09cb370 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:25.287706 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6449c-2257-4b5d-bf01-53eaf09cb370 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:25.289195 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 402/791] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:25.294069 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06cc3e-1e3a-4e1f-9106-99d76c800aec None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:25.294458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06cc3e-1e3a-4e1f-9106-99d76c800aec None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:25.294759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06cc3e-1e3a-4e1f-9106-99d76c800aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:25.311561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-ad06cc3e-1e3a-4e1f-9106-99d76c800aec None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:25.312757 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-ad06cc3e-1e3a-4e1f-9106-99d76c800aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:25.380475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 390/792] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:25 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:25.407239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6449c-2257-4b5d-bf01-53eaf09cb370 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:25.511989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6449c-2257-4b5d-bf01-53eaf09cb370 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:25.537993 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:25.551126 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e52a58-7dc7-4eae-a31a-02495dacd382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:25.552018 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e52a58-7dc7-4eae-a31a-02495dacd382 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:25.552288 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e52a58-7dc7-4eae-a31a-02495dacd382 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:25.552567 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e52a58-7dc7-4eae-a31a-02495dacd382 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:25.553231 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e52a58-7dc7-4eae-a31a-02495dacd382 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:25.555238 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e52a58-7dc7-4eae-a31a-02495dacd382 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-10e52a58-7dc7-4eae-a31a-02495dacd382 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:25.568160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:25.569389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:25.570249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 403/793] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:43:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:25.575392 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06cc3e-1e3a-4e1f-9106-99d76c800aec None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:25.591068 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:25.681893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06cc3e-1e3a-4e1f-9106-99d76c800aec None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:25.718327 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e7128-ed2f-4516-899c-bdf12cad53da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:25.718985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e7128-ed2f-4516-899c-bdf12cad53da None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:25.719265 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e7128-ed2f-4516-899c-bdf12cad53da None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:25.719539 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e7128-ed2f-4516-899c-bdf12cad53da None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:25.720236 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e7128-ed2f-4516-899c-bdf12cad53da None admin] RBAC: Adding query filter params (name=compute) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:25.723476 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e7128-ed2f-4516-899c-bdf12cad53da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:25.723476 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e7128-ed2f-4516-899c-bdf12cad53da None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:25.727711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 391/794] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:25.733945 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e52a58-7dc7-4eae-a31a-02495dacd382 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:25.839968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e52a58-7dc7-4eae-a31a-02495dacd382 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:25.884484 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685beba-85ff-45d1-ab38-d92c95347560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:25.885151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685beba-85ff-45d1-ab38-d92c95347560 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:25.885462 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685beba-85ff-45d1-ab38-d92c95347560 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:25.886827 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685beba-85ff-45d1-ab38-d92c95347560 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:25.886827 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685beba-85ff-45d1-ab38-d92c95347560 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:25.886827 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685beba-85ff-45d1-ab38-d92c95347560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:25.888152 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685beba-85ff-45d1-ab38-d92c95347560 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:25.893346 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 404/795] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:26.662077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae00b1-931c-456e-a23f-de041449dd0c None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:26.662602 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae00b1-931c-456e-a23f-de041449dd0c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:26.662714 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae00b1-931c-456e-a23f-de041449dd0c None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:26.663987 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 392/796] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:26.669367 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8523d07-8044-4c3e-ab2f-90026c0c1396 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:26.669797 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8523d07-8044-4c3e-ab2f-90026c0c1396 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:26.670523 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8523d07-8044-4c3e-ab2f-90026c0c1396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:26.687298 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-d8523d07-8044-4c3e-ab2f-90026c0c1396 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:26.688449 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-d8523d07-8044-4c3e-ab2f-90026c0c1396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:26.731381 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:26.753112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 405/797] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:26.777637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae00b1-931c-456e-a23f-de041449dd0c None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:26.853625 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:26.877849 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae00b1-931c-456e-a23f-de041449dd0c None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:26.915911 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:26.916497 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:26.916781 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:26.917059 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:26.917803 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:26.919234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:26.920621 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WARNING keystone.server.flask.common [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 18:43:26.937775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.sql.core [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 18:43:26.937775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 18:43:26.937775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [parameters: {'id': 'b2d426185fb245eea8541ace16959b03', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 18:43:26.937775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93676) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2d426185fb245eea8541ace16959b03.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2d426185fb245eea8541ace16959b03. Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:43:26.954991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application result.read() Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 18:43:26.955994 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application yield resource Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise self.value Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application session.commit() Jul 12 18:43:26.957026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self.session.flush() Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application compat.raise_( Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 18:43:26.958087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 18:43:26.959058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application result.read() Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:43:26.959893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [parameters: {'id': 'b2d426185fb245eea8541ace16959b03', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:26.960811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:26.964457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:26.965654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:26.965654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 18:43:26.965654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 18:43:26.965654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:26.965654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:26.965654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 18:43:26.965654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 18:43:26.965654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b2d426185fb245eea8541ace16959b03. Jul 12 18:43:26.965654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:26.965654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 393/798] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Jul 12 18:43:26 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:26.966343 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8523d07-8044-4c3e-ab2f-90026c0c1396 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:27.060448 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8523d07-8044-4c3e-ab2f-90026c0c1396 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:27.093819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05157617-e482-4eea-8433-7c062b2d9262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:27.094604 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05157617-e482-4eea-8433-7c062b2d9262 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:27.094887 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05157617-e482-4eea-8433-7c062b2d9262 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:27.095162 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05157617-e482-4eea-8433-7c062b2d9262 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:27.101818 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05157617-e482-4eea-8433-7c062b2d9262 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:27.103317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05157617-e482-4eea-8433-7c062b2d9262 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-05157617-e482-4eea-8433-7c062b2d9262 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:43:27.117271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:27.118384 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:27.119402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:43:27.119402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:43:27.119402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:43:27.119402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:43:27.119402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:43:27.119402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:43:27.119402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:43:27.119402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:27.119402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 406/799] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:27.125233 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:27.226246 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f407cb-6c72-482e-a9f2-6d33bc6daa7c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:27.262865 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:27.269204 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c97c01-7b6d-45f2-8671-07bad299a07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:27.269706 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c97c01-7b6d-45f2-8671-07bad299a07c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:27.269706 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c97c01-7b6d-45f2-8671-07bad299a07c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:27.270082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c97c01-7b6d-45f2-8671-07bad299a07c None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:27.270983 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c97c01-7b6d-45f2-8671-07bad299a07c None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:27.271299 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c97c01-7b6d-45f2-8671-07bad299a07c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:27.272896 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c97c01-7b6d-45f2-8671-07bad299a07c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:27.292380 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 394/800] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:28.121623 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acab8b-04c1-4b32-b1fa-4d140eda95bd None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:28.122141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acab8b-04c1-4b32-b1fa-4d140eda95bd None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:28.122227 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acab8b-04c1-4b32-b1fa-4d140eda95bd None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:28.123603 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 407/801] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:28.128968 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd200-d867-4c3d-a01d-7fb0abb6b98e None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:28.129411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd200-d867-4c3d-a01d-7fb0abb6b98e None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:28.129563 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd200-d867-4c3d-a01d-7fb0abb6b98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:28.146945 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-f5bfd200-d867-4c3d-a01d-7fb0abb6b98e None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:28.148386 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-f5bfd200-d867-4c3d-a01d-7fb0abb6b98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:28.212870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 395/802] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:28 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:28.239730 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acab8b-04c1-4b32-b1fa-4d140eda95bd None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:28.282696 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:28.343839 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acab8b-04c1-4b32-b1fa-4d140eda95bd None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:28.377060 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71875f70-9e07-471e-a304-21c0386007d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:28.377740 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71875f70-9e07-471e-a304-21c0386007d7 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:28.378023 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71875f70-9e07-471e-a304-21c0386007d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:28.378392 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71875f70-9e07-471e-a304-21c0386007d7 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:28.379107 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71875f70-9e07-471e-a304-21c0386007d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:28.380464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71875f70-9e07-471e-a304-21c0386007d7 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:28.393691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 408/803] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Jul 12 18:43:28 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:43:29.578802 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134d8c0-c68b-4926-9cf9-0c74769fd16b None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:29.579329 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134d8c0-c68b-4926-9cf9-0c74769fd16b None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:29.579415 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134d8c0-c68b-4926-9cf9-0c74769fd16b None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:29.580735 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 396/804] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:29.586120 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537b8f-97d8-4ca6-b143-340eba8769e3 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:29.586643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537b8f-97d8-4ca6-b143-340eba8769e3 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:29.586987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df537b8f-97d8-4ca6-b143-340eba8769e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:29.605887 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-df537b8f-97d8-4ca6-b143-340eba8769e3 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:29.607059 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-df537b8f-97d8-4ca6-b143-340eba8769e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:29.676122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 409/805] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:29 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:43:29.702155 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134d8c0-c68b-4926-9cf9-0c74769fd16b None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:29.799980 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134d8c0-c68b-4926-9cf9-0c74769fd16b None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:29.821875 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:29.834106 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87745b00-3130-4b03-a6af-afb4ed8e2570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:29.834704 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87745b00-3130-4b03-a6af-afb4ed8e2570 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:29.834986 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87745b00-3130-4b03-a6af-afb4ed8e2570 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:29.835264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87745b00-3130-4b03-a6af-afb4ed8e2570 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:29.835956 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87745b00-3130-4b03-a6af-afb4ed8e2570 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:29.837407 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87745b00-3130-4b03-a6af-afb4ed8e2570 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:29.850302 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.sql.core [None req-87745b00-3130-4b03-a6af-afb4ed8e2570 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 18:43:29.850302 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 18:43:29.850302 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [parameters: {'user_id': '421c05b2fd104128a24a97f16b2b2a24', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 18:43:29.850302 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93676) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-87745b00-3130-4b03-a6af-afb4ed8e2570 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application result.read() Jul 12 18:43:29.857561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:43:29.858499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application yield resource Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise self.value Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application session.commit() Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 18:43:29.859477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self.session.flush() Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application compat.raise_( Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 18:43:29.860357 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:43:29.861253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application result.read() Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:43:29.863208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [parameters: {'user_id': '421c05b2fd104128a24a97f16b2b2a24', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:29.864277 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 18:43:29.865252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 18:43:29.866482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 18:43:29.866482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 18:43:29.866482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 18:43:29.866482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 18:43:29.866482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 18:43:29.866482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:29.866482 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 397/806] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Jul 12 18:43:29 2022] POST /identity/v3/users => generated 160 bytes in 158 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:29.866964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df537b8f-97d8-4ca6-b143-340eba8769e3 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:29.893900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:29.967675 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df537b8f-97d8-4ca6-b143-340eba8769e3 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:30.000307 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7649549-dce7-44e2-b4f4-41a2171ead10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:30.001105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7649549-dce7-44e2-b4f4-41a2171ead10 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:30.001489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7649549-dce7-44e2-b4f4-41a2171ead10 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:30.001772 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7649549-dce7-44e2-b4f4-41a2171ead10 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:30.008578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7649549-dce7-44e2-b4f4-41a2171ead10 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:30.010031 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7649549-dce7-44e2-b4f4-41a2171ead10 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-d7649549-dce7-44e2-b4f4-41a2171ead10 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:43:30.024846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:30.025834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:30.026774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 410/807] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:43:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:30.032313 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87745b00-3130-4b03-a6af-afb4ed8e2570 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:30.130693 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87745b00-3130-4b03-a6af-afb4ed8e2570 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:30.165118 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20205a-9768-42b1-a348-1b564d0fcfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:30.165886 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20205a-9768-42b1-a348-1b564d0fcfec None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:30.166170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20205a-9768-42b1-a348-1b564d0fcfec None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:30.166447 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20205a-9768-42b1-a348-1b564d0fcfec None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:30.167237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20205a-9768-42b1-a348-1b564d0fcfec None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:30.167541 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20205a-9768-42b1-a348-1b564d0fcfec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:30.169164 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20205a-9768-42b1-a348-1b564d0fcfec None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:30.206650 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 398/808] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Jul 12 18:43:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:30.615924 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073fd19-3ea1-44e8-8fff-6fa46b7a2897 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:30.616456 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073fd19-3ea1-44e8-8fff-6fa46b7a2897 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:30.616456 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4073fd19-3ea1-44e8-8fff-6fa46b7a2897 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:30.617869 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 411/809] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:30.622961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f584e-498d-4dca-bed5-bc9f1358376d None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:30.623335 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f584e-498d-4dca-bed5-bc9f1358376d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:30.623521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f584e-498d-4dca-bed5-bc9f1358376d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:30.639922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-311f584e-498d-4dca-bed5-bc9f1358376d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:30.641445 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-311f584e-498d-4dca-bed5-bc9f1358376d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:30.675661 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:30.706499 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 399/810] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:30 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:30.730294 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073fd19-3ea1-44e8-8fff-6fa46b7a2897 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:30.812450 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:30.827556 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4073fd19-3ea1-44e8-8fff-6fa46b7a2897 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:30.860430 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb7148-e209-4b46-b4fb-ab8da2e5787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:30.861204 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb7148-e209-4b46-b4fb-ab8da2e5787f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:30.861515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb7148-e209-4b46-b4fb-ab8da2e5787f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:30.861791 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb7148-e209-4b46-b4fb-ab8da2e5787f None admin] PATH_INFO: `/v3/services/compute` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:30.862436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb7148-e209-4b46-b4fb-ab8da2e5787f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:30.863790 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb7148-e209-4b46-b4fb-ab8da2e5787f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-6deb7148-e209-4b46-b4fb-ab8da2e5787f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:30.875524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:30.881373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:43:30.882280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 412/811] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:43:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:43:30.883586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f584e-498d-4dca-bed5-bc9f1358376d None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:30.978581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f584e-498d-4dca-bed5-bc9f1358376d None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:31.010197 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1dbef-1ffd-48d2-80e9-11b27dccaba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:31.010839 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1dbef-1ffd-48d2-80e9-11b27dccaba0 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:31.011118 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1dbef-1ffd-48d2-80e9-11b27dccaba0 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:31.011391 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1dbef-1ffd-48d2-80e9-11b27dccaba0 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:31.012082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1dbef-1ffd-48d2-80e9-11b27dccaba0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:31.012385 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1dbef-1ffd-48d2-80e9-11b27dccaba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:31.014291 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1dbef-1ffd-48d2-80e9-11b27dccaba0 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:31.018963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 400/812] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:31.024866 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb7148-e209-4b46-b4fb-ab8da2e5787f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:31.120150 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb7148-e209-4b46-b4fb-ab8da2e5787f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:31.153306 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4dedb-7e6a-4bce-ad34-b8c274599a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:31.153918 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4dedb-7e6a-4bce-ad34-b8c274599a30 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:31.154249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4dedb-7e6a-4bce-ad34-b8c274599a30 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:31.155030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4dedb-7e6a-4bce-ad34-b8c274599a30 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:31.155982 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4dedb-7e6a-4bce-ad34-b8c274599a30 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:31.156289 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4dedb-7e6a-4bce-ad34-b8c274599a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:31.157665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4dedb-7e6a-4bce-ad34-b8c274599a30 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:31.162394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 413/813] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:31.168309 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1dbef-1ffd-48d2-80e9-11b27dccaba0 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:31.202021 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:31.263514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1dbef-1ffd-48d2-80e9-11b27dccaba0 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:31.296769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e09b064-537d-4aef-9f3a-b762973c9b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:31.297447 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09b064-537d-4aef-9f3a-b762973c9b50 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:31.297733 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09b064-537d-4aef-9f3a-b762973c9b50 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:31.298013 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e09b064-537d-4aef-9f3a-b762973c9b50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:31.298784 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09b064-537d-4aef-9f3a-b762973c9b50 None admin] RBAC: Adding query filter params (interface=public, service_id=9ffcd4e8343e4961832c794cc5fd8097, region_id=RegionOne) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:31.299094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09b064-537d-4aef-9f3a-b762973c9b50 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:31.300439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e09b064-537d-4aef-9f3a-b762973c9b50 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:31.305314 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 401/814] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Jul 12 18:43:31 2022] GET /identity/v3/endpoints?service_id=9ffcd4e8343e4961832c794cc5fd8097&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:31.310605 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4dedb-7e6a-4bce-ad34-b8c274599a30 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:31.326357 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:31.408680 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4dedb-7e6a-4bce-ad34-b8c274599a30 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:31.440966 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af902e7e-1b8c-45a3-a480-a4aa7196ceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:31.441636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af902e7e-1b8c-45a3-a480-a4aa7196ceae None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:31.441918 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af902e7e-1b8c-45a3-a480-a4aa7196ceae None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:31.442198 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af902e7e-1b8c-45a3-a480-a4aa7196ceae None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:31.442864 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af902e7e-1b8c-45a3-a480-a4aa7196ceae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:31.444209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af902e7e-1b8c-45a3-a480-a4aa7196ceae None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:31.450334 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 414/815] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Jul 12 18:43:31 2022] GET /identity/v3/services => generated 1728 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:43:33.655457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3e55c-c9f1-4cb3-8e00-9a90d558ab47 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:33.656232 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3e55c-c9f1-4cb3-8e00-9a90d558ab47 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:33.656343 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3e55c-c9f1-4cb3-8e00-9a90d558ab47 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:33.657656 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 402/816] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:43:33.662750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d11d5-dac5-4be5-9a3f-67a4c6a9d428 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:33.663139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d11d5-dac5-4be5-9a3f-67a4c6a9d428 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:33.663310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d11d5-dac5-4be5-9a3f-67a4c6a9d428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:33.680002 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-844d11d5-dac5-4be5-9a3f-67a4c6a9d428 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:43:33.681160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-844d11d5-dac5-4be5-9a3f-67a4c6a9d428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:43:33.743663 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 415/817] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:43:33 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:43:33.767689 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3e55c-c9f1-4cb3-8e00-9a90d558ab47 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:33.862328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:33.867939 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3e55c-c9f1-4cb3-8e00-9a90d558ab47 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:33.900370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37808d37-17c1-41a1-a131-8427664be997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:33.901149 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37808d37-17c1-41a1-a131-8427664be997 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:33.901463 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37808d37-17c1-41a1-a131-8427664be997 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:33.901742 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37808d37-17c1-41a1-a131-8427664be997 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:33.902389 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37808d37-17c1-41a1-a131-8427664be997 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:33.903748 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37808d37-17c1-41a1-a131-8427664be997 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-37808d37-17c1-41a1-a131-8427664be997 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:43:33.915985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:43:33.917107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:43:33.918006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 403/818] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:43:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:43:33.923558 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d11d5-dac5-4be5-9a3f-67a4c6a9d428 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:33.933366 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:34.023506 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d11d5-dac5-4be5-9a3f-67a4c6a9d428 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:34.056053 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c8d04-efea-457d-bf97-8424618f2f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:34.056692 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c8d04-efea-457d-bf97-8424618f2f81 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:34.056972 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c8d04-efea-457d-bf97-8424618f2f81 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:34.057245 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c8d04-efea-457d-bf97-8424618f2f81 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:34.057962 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c8d04-efea-457d-bf97-8424618f2f81 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:34.058264 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c8d04-efea-457d-bf97-8424618f2f81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:34.059608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c8d04-efea-457d-bf97-8424618f2f81 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:34.064234 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 416/819] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:34.069981 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37808d37-17c1-41a1-a131-8427664be997 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:34.167721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37808d37-17c1-41a1-a131-8427664be997 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:34.199922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c32fda-960b-4447-b216-f0135b3176f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:34.200576 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c32fda-960b-4447-b216-f0135b3176f9 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:34.200858 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c32fda-960b-4447-b216-f0135b3176f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:34.201670 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c32fda-960b-4447-b216-f0135b3176f9 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:34.202362 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c32fda-960b-4447-b216-f0135b3176f9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:43:34.202667 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c32fda-960b-4447-b216-f0135b3176f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:34.204018 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c32fda-960b-4447-b216-f0135b3176f9 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:34.208700 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 404/820] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Jul 12 18:43:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:43:34.214385 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c8d04-efea-457d-bf97-8424618f2f81 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:43:34.281500 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:34.309218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c8d04-efea-457d-bf97-8424618f2f81 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:43:34.342317 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad0821-dea9-4190-b732-5dd33e7acedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:43:34.342956 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad0821-dea9-4190-b732-5dd33e7acedd None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:43:34.343236 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad0821-dea9-4190-b732-5dd33e7acedd None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:43:34.343506 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad0821-dea9-4190-b732-5dd33e7acedd None admin] PATH_INFO: `/v3/endpoints` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:43:34.344222 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad0821-dea9-4190-b732-5dd33e7acedd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:43:34.345587 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad0821-dea9-4190-b732-5dd33e7acedd None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:43:34.363697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 417/821] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Jul 12 18:43:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:43:44.206413 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=86 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:44.359485 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:35.150606 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c44c4-80d7-422d-99f7-58c86cdc837b None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:35.151144 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c44c4-80d7-422d-99f7-58c86cdc837b None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:35.151144 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c44c4-80d7-422d-99f7-58c86cdc837b None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:35.153231 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 405/822] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:44:35.159410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1f37c-f6be-4b1c-9d00-9360e9f48015 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:35.160016 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1f37c-f6be-4b1c-9d00-9360e9f48015 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:35.160142 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1f37c-f6be-4b1c-9d00-9360e9f48015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:35.181001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-14f1f37c-f6be-4b1c-9d00-9360e9f48015 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:44:35.182471 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-14f1f37c-f6be-4b1c-9d00-9360e9f48015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:35.268189 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 418/823] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:44:35 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:44:35.296833 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c44c4-80d7-422d-99f7-58c86cdc837b None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:35.417914 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56c44c4-80d7-422d-99f7-58c86cdc837b None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:35.459998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0025638-84a4-4c89-a3ce-77afdde803e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:35.460808 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025638-84a4-4c89-a3ce-77afdde803e4 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:35.461093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025638-84a4-4c89-a3ce-77afdde803e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:35.461406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0025638-84a4-4c89-a3ce-77afdde803e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:35.474506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0025638-84a4-4c89-a3ce-77afdde803e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:35.476064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0025638-84a4-4c89-a3ce-77afdde803e4 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-c0025638-84a4-4c89-a3ce-77afdde803e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:35.496116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:35.497363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:35.498340 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:35.498340 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:35.498340 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:35.498340 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:35.498340 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 406/824] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:35.504691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1f37c-f6be-4b1c-9d00-9360e9f48015 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:35.631402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1f37c-f6be-4b1c-9d00-9360e9f48015 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:35.664069 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:35.676793 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b517030-bcc6-45a2-bb54-71af727c3e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:35.677827 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b517030-bcc6-45a2-bb54-71af727c3e8f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:35.678204 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b517030-bcc6-45a2-bb54-71af727c3e8f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:35.678649 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b517030-bcc6-45a2-bb54-71af727c3e8f None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:35.679605 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b517030-bcc6-45a2-bb54-71af727c3e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:35.680093 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b517030-bcc6-45a2-bb54-71af727c3e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:35.681716 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b517030-bcc6-45a2-bb54-71af727c3e8f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:35.694470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 419/825] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:35.701139 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0025638-84a4-4c89-a3ce-77afdde803e4 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:35.765390 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:35.819186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0025638-84a4-4c89-a3ce-77afdde803e4 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:35.862915 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb717106-f63b-4582-b1c0-77ed7b9805c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:35.862915 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717106-f63b-4582-b1c0-77ed7b9805c3 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:35.863210 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717106-f63b-4582-b1c0-77ed7b9805c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:35.863453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb717106-f63b-4582-b1c0-77ed7b9805c3 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:35.864005 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb717106-f63b-4582-b1c0-77ed7b9805c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:35.865518 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb717106-f63b-4582-b1c0-77ed7b9805c3 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:35.893522 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 407/826] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Jul 12 18:44:35 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:44:38.314235 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ff203-9722-416d-8636-988c3e0d6d5e None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:38.314800 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ff203-9722-416d-8636-988c3e0d6d5e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:38.314800 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ff203-9722-416d-8636-988c3e0d6d5e None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:38.316131 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 420/827] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:44:38.321741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a90b4-69f6-4857-a44a-155104072694 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:38.322178 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a90b4-69f6-4857-a44a-155104072694 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:38.322373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a90b4-69f6-4857-a44a-155104072694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:38.344970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-852a90b4-69f6-4857-a44a-155104072694 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:44:38.346938 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-852a90b4-69f6-4857-a44a-155104072694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:38.433063 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 408/828] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:44:38 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:44:38.458844 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ff203-9722-416d-8636-988c3e0d6d5e None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:38.580982 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ff203-9722-416d-8636-988c3e0d6d5e None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:38.621882 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784ff8d-76a0-4c26-8ffe-06d8b3b45ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:38.622799 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ff8d-76a0-4c26-8ffe-06d8b3b45ecf None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:38.623117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ff8d-76a0-4c26-8ffe-06d8b3b45ecf None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:38.623598 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784ff8d-76a0-4c26-8ffe-06d8b3b45ecf None admin] PATH_INFO: `/v3/roles/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:38.635666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784ff8d-76a0-4c26-8ffe-06d8b3b45ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-f784ff8d-76a0-4c26-8ffe-06d8b3b45ecf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:44:38.644168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:38.645221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:44:38.646151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:38.650886 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 421/829] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:44:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:38.651933 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a90b4-69f6-4857-a44a-155104072694 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:38.695291 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:38.766113 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a90b4-69f6-4857-a44a-155104072694 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:38.806792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71bead-8dc2-4dd5-bfc3-56491598b8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:38.807453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71bead-8dc2-4dd5-bfc3-56491598b8e6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:38.807736 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71bead-8dc2-4dd5-bfc3-56491598b8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:38.808006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71bead-8dc2-4dd5-bfc3-56491598b8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:38.809422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71bead-8dc2-4dd5-bfc3-56491598b8e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:38.809722 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71bead-8dc2-4dd5-bfc3-56491598b8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:38.811068 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71bead-8dc2-4dd5-bfc3-56491598b8e6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:38.821729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 409/830] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:44:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:38.828398 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784ff8d-76a0-4c26-8ffe-06d8b3b45ecf None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:38.880028 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:38.943390 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784ff8d-76a0-4c26-8ffe-06d8b3b45ecf None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:38.983072 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3bea7-245e-4120-bf6b-14f9888a1445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:38.983937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bea7-245e-4120-bf6b-14f9888a1445 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:38.984257 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bea7-245e-4120-bf6b-14f9888a1445 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:38.984570 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3bea7-245e-4120-bf6b-14f9888a1445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:38.996702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3bea7-245e-4120-bf6b-14f9888a1445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:38.998416 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3bea7-245e-4120-bf6b-14f9888a1445 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-0dc3bea7-245e-4120-bf6b-14f9888a1445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:39.017391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:39.018614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:39.019636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:39.019636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:39.019636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:39.019636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:39.024098 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 422/831] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:39.025604 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71bead-8dc2-4dd5-bfc3-56491598b8e6 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:39.141072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:39.144491 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71bead-8dc2-4dd5-bfc3-56491598b8e6 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:39.184846 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dddc6e-ab71-4899-9970-4793a0fd42f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:39.185545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dddc6e-ab71-4899-9970-4793a0fd42f6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:39.185876 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dddc6e-ab71-4899-9970-4793a0fd42f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:39.186133 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dddc6e-ab71-4899-9970-4793a0fd42f6 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:39.187031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dddc6e-ab71-4899-9970-4793a0fd42f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:39.187440 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dddc6e-ab71-4899-9970-4793a0fd42f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:39.188998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dddc6e-ab71-4899-9970-4793a0fd42f6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:39.203593 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 410/832] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:39.210812 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3bea7-245e-4120-bf6b-14f9888a1445 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:39.320878 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:39.324871 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3bea7-245e-4120-bf6b-14f9888a1445 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:39.367209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a748781-2dc7-4648-b951-6f9bac384ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:39.368176 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748781-2dc7-4648-b951-6f9bac384ba6 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:39.368455 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748781-2dc7-4648-b951-6f9bac384ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:39.368730 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a748781-2dc7-4648-b951-6f9bac384ba6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:39.377105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a748781-2dc7-4648-b951-6f9bac384ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:39.378876 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a748781-2dc7-4648-b951-6f9bac384ba6 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-1a748781-2dc7-4648-b951-6f9bac384ba6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:44:39.396713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:39.397785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:39.398720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 423/833] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:44:39.408666 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dddc6e-ab71-4899-9970-4793a0fd42f6 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:39.518136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dddc6e-ab71-4899-9970-4793a0fd42f6 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:39.556133 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ba6d7-49a3-4d36-b300-85b09bffc596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:39.556815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ba6d7-49a3-4d36-b300-85b09bffc596 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:39.557097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ba6d7-49a3-4d36-b300-85b09bffc596 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:39.557456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ba6d7-49a3-4d36-b300-85b09bffc596 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:39.558332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ba6d7-49a3-4d36-b300-85b09bffc596 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:39.558719 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ba6d7-49a3-4d36-b300-85b09bffc596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:39.560231 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ba6d7-49a3-4d36-b300-85b09bffc596 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:39.580585 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 411/834] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Jul 12 18:44:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:39.587535 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a748781-2dc7-4648-b951-6f9bac384ba6 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:39.695151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a748781-2dc7-4648-b951-6f9bac384ba6 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:39.731913 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75ae92-2b3a-461e-8f5c-6935e357822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:39.732615 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75ae92-2b3a-461e-8f5c-6935e357822f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:39.732884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75ae92-2b3a-461e-8f5c-6935e357822f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:39.736975 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75ae92-2b3a-461e-8f5c-6935e357822f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:39.763000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:39.808279 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75ae92-2b3a-461e-8f5c-6935e357822f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:39.810015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75ae92-2b3a-461e-8f5c-6935e357822f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:39.920572 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 424/835] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:44:39 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:44:39.926571 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ba6d7-49a3-4d36-b300-85b09bffc596 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:39.947837 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:40.037643 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ba6d7-49a3-4d36-b300-85b09bffc596 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:40.078694 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7859-e855-4cac-ae6e-87ca1fcb91b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:40.079479 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7859-e855-4cac-ae6e-87ca1fcb91b9 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:40.079760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7859-e855-4cac-ae6e-87ca1fcb91b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:40.080034 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd7859-e855-4cac-ae6e-87ca1fcb91b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:40.091388 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd7859-e855-4cac-ae6e-87ca1fcb91b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:40.093084 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd7859-e855-4cac-ae6e-87ca1fcb91b9 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-0abd7859-e855-4cac-ae6e-87ca1fcb91b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:40.110659 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:40.111737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:40.112792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:40.112792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:40.112792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:40.112792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:40.112792 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 412/836] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:40.117715 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75ae92-2b3a-461e-8f5c-6935e357822f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:40.180444 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:40.227465 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75ae92-2b3a-461e-8f5c-6935e357822f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:40.267892 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86039da-7818-4c6b-8066-7693b2d53b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:40.268554 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86039da-7818-4c6b-8066-7693b2d53b2f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:40.268836 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86039da-7818-4c6b-8066-7693b2d53b2f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:40.269115 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86039da-7818-4c6b-8066-7693b2d53b2f None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:40.269876 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86039da-7818-4c6b-8066-7693b2d53b2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:40.270186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86039da-7818-4c6b-8066-7693b2d53b2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:40.271932 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86039da-7818-4c6b-8066-7693b2d53b2f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:40.287014 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 425/837] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:40.292755 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7859-e855-4cac-ae6e-87ca1fcb91b9 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:40.367103 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:40.406562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd7859-e855-4cac-ae6e-87ca1fcb91b9 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:40.444914 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94625be3-5077-41bf-b5d4-c31e9f81f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:40.445728 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94625be3-5077-41bf-b5d4-c31e9f81f024 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:40.446038 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94625be3-5077-41bf-b5d4-c31e9f81f024 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:40.446323 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94625be3-5077-41bf-b5d4-c31e9f81f024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:40.454427 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94625be3-5077-41bf-b5d4-c31e9f81f024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:40.456085 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94625be3-5077-41bf-b5d4-c31e9f81f024 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-94625be3-5077-41bf-b5d4-c31e9f81f024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:44:40.469970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:40.471258 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:40.472169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:44:40.472169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:44:40.472169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:44:40.472169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:44:40.472169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:44:40.472169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:44:40.472169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:44:40.472169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:40.472169 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 413/838] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:44:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:40.477689 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86039da-7818-4c6b-8066-7693b2d53b2f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:40.596359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86039da-7818-4c6b-8066-7693b2d53b2f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:40.616229 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:40.635519 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88a9e9-3b1a-4da7-bc27-236f6259283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:40.636175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88a9e9-3b1a-4da7-bc27-236f6259283f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:40.636456 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88a9e9-3b1a-4da7-bc27-236f6259283f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:40.637401 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88a9e9-3b1a-4da7-bc27-236f6259283f None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:40.638199 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88a9e9-3b1a-4da7-bc27-236f6259283f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:40.638545 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88a9e9-3b1a-4da7-bc27-236f6259283f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:40.640164 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88a9e9-3b1a-4da7-bc27-236f6259283f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:40.653150 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 426/839] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:44:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:44:40.659678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94625be3-5077-41bf-b5d4-c31e9f81f024 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:40.774448 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94625be3-5077-41bf-b5d4-c31e9f81f024 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:40.807718 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:40.814151 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e1274-3e71-4893-a7bc-7ea08acbcdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:40.814849 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e1274-3e71-4893-a7bc-7ea08acbcdca None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:40.815136 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e1274-3e71-4893-a7bc-7ea08acbcdca None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:40.815413 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e1274-3e71-4893-a7bc-7ea08acbcdca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:40.816232 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e1274-3e71-4893-a7bc-7ea08acbcdca None admin] RBAC: Adding query filter params (role.id=5d30b117c7cb45a6ae69d3f19986213d, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=ce92f306929849f98a89e3dadb26cb37) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:40.816543 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e1274-3e71-4893-a7bc-7ea08acbcdca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:40.818034 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e1274-3e71-4893-a7bc-7ea08acbcdca None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:40.823886 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 414/840] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:44:40 2022] GET /identity/v3/role_assignments?user.id=ce92f306929849f98a89e3dadb26cb37&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=5d30b117c7cb45a6ae69d3f19986213d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:43.151201 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a488f-59b9-4c49-b58e-97107fdee57c None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:43.151716 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a488f-59b9-4c49-b58e-97107fdee57c None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:43.151716 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a488f-59b9-4c49-b58e-97107fdee57c None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:43.153033 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 427/841] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:44:43.158826 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6030-1e9e-4fb8-bff3-0e2586efadd0 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:43.159272 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6030-1e9e-4fb8-bff3-0e2586efadd0 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:43.159504 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd6030-1e9e-4fb8-bff3-0e2586efadd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:43.179316 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-89bd6030-1e9e-4fb8-bff3-0e2586efadd0 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:44:43.180589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-89bd6030-1e9e-4fb8-bff3-0e2586efadd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:43.253793 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 415/842] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:44:43 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:44:43.279613 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a488f-59b9-4c49-b58e-97107fdee57c None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:43.388909 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a488f-59b9-4c49-b58e-97107fdee57c None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:43.426953 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf7661-20c8-4b39-8e13-2072bafe7eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:43.427652 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf7661-20c8-4b39-8e13-2072bafe7eea None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:43.427959 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf7661-20c8-4b39-8e13-2072bafe7eea None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:43.428290 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf7661-20c8-4b39-8e13-2072bafe7eea None admin] PATH_INFO: `/v3/roles/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:43.439875 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf7661-20c8-4b39-8e13-2072bafe7eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-bcbf7661-20c8-4b39-8e13-2072bafe7eea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:44:43.448408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:43.449561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:43.450400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 428/843] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:44:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:43.456115 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6030-1e9e-4fb8-bff3-0e2586efadd0 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:43.563694 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd6030-1e9e-4fb8-bff3-0e2586efadd0 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:43.588887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:43.601441 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66361ae-6898-40b0-8f1f-b67c0c6f6634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:43.602103 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66361ae-6898-40b0-8f1f-b67c0c6f6634 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:43.602385 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66361ae-6898-40b0-8f1f-b67c0c6f6634 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:43.602654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66361ae-6898-40b0-8f1f-b67c0c6f6634 None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:43.603389 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66361ae-6898-40b0-8f1f-b67c0c6f6634 None admin] RBAC: Adding query filter params (name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:43.603682 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66361ae-6898-40b0-8f1f-b67c0c6f6634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:43.605959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66361ae-6898-40b0-8f1f-b67c0c6f6634 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:43.615152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 416/844] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:44:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:44:43.620960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf7661-20c8-4b39-8e13-2072bafe7eea None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:43.664001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:43.729205 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf7661-20c8-4b39-8e13-2072bafe7eea None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:43.768564 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a313d-df1a-4188-a336-33a260d48c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:43.769504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a313d-df1a-4188-a336-33a260d48c79 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:43.769850 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a313d-df1a-4188-a336-33a260d48c79 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:43.770129 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a313d-df1a-4188-a336-33a260d48c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:43.781859 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a313d-df1a-4188-a336-33a260d48c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:43.783378 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a313d-df1a-4188-a336-33a260d48c79 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-cb6a313d-df1a-4188-a336-33a260d48c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:43.803671 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:43.804643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:43.805585 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:43.805585 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:43.805585 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:43.805585 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:43.805585 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 429/845] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:43.811119 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66361ae-6898-40b0-8f1f-b67c0c6f6634 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:43.919977 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66361ae-6898-40b0-8f1f-b67c0c6f6634 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:43.955505 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f445b-3f93-4b5b-836e-f5200df62896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:43.956158 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f445b-3f93-4b5b-836e-f5200df62896 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:43.956439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f445b-3f93-4b5b-836e-f5200df62896 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:43.956711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f445b-3f93-4b5b-836e-f5200df62896 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:43.957452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f445b-3f93-4b5b-836e-f5200df62896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:43.957754 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f445b-3f93-4b5b-836e-f5200df62896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:43.959105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f445b-3f93-4b5b-836e-f5200df62896 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:43.971238 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 417/846] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:43.977056 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a313d-df1a-4188-a336-33a260d48c79 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:44.084383 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:44.096116 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a313d-df1a-4188-a336-33a260d48c79 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:44.137534 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b9c97-2221-4d56-8902-603e8fa5516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:44.138555 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b9c97-2221-4d56-8902-603e8fa5516c None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:44.138900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b9c97-2221-4d56-8902-603e8fa5516c None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:44.139210 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b9c97-2221-4d56-8902-603e8fa5516c None admin] PATH_INFO: `/v3/users/placement` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:44.147745 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b9c97-2221-4d56-8902-603e8fa5516c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:44.149343 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b9c97-2221-4d56-8902-603e8fa5516c None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-d03b9c97-2221-4d56-8902-603e8fa5516c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:44:44.165111 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:44.166897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:44.168276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 430/847] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:44.172276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f445b-3f93-4b5b-836e-f5200df62896 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:44.229501 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:44.291806 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f445b-3f93-4b5b-836e-f5200df62896 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:44.331200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9148d0c-ed7c-4b7b-b954-18070fa78fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:44.331969 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9148d0c-ed7c-4b7b-b954-18070fa78fda None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:44.332332 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9148d0c-ed7c-4b7b-b954-18070fa78fda None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:44.332528 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9148d0c-ed7c-4b7b-b954-18070fa78fda None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:44.333437 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9148d0c-ed7c-4b7b-b954-18070fa78fda None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:44.333747 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9148d0c-ed7c-4b7b-b954-18070fa78fda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:44.335226 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9148d0c-ed7c-4b7b-b954-18070fa78fda None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:44.357498 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 418/848] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Jul 12 18:44:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:44.363730 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b9c97-2221-4d56-8902-603e8fa5516c None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:44.481061 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b9c97-2221-4d56-8902-603e8fa5516c None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:44.518465 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d48486-78f0-457e-9442-810b5d47bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:44.519279 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d48486-78f0-457e-9442-810b5d47bd3d None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:44.519560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d48486-78f0-457e-9442-810b5d47bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:44.519835 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d48486-78f0-457e-9442-810b5d47bd3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:44.530979 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d48486-78f0-457e-9442-810b5d47bd3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:44.532402 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d48486-78f0-457e-9442-810b5d47bd3d None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-a3d48486-78f0-457e-9442-810b5d47bd3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:44.551895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:44.553030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:44.553974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:44.553974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:44.553974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:44.553974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:44.553974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 431/849] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:44.560804 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9148d0c-ed7c-4b7b-b954-18070fa78fda None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:44.671738 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9148d0c-ed7c-4b7b-b954-18070fa78fda None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:44.674027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:44.706373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c534257-b1e0-4342-90ae-ba37aa17c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:44.707030 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c534257-b1e0-4342-90ae-ba37aa17c0af None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:44.707313 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c534257-b1e0-4342-90ae-ba37aa17c0af None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:44.707587 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c534257-b1e0-4342-90ae-ba37aa17c0af None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:44.708298 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c534257-b1e0-4342-90ae-ba37aa17c0af None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:44.708603 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c534257-b1e0-4342-90ae-ba37aa17c0af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:44.709998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c534257-b1e0-4342-90ae-ba37aa17c0af None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:44.722679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 419/850] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:44:44.729720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d48486-78f0-457e-9442-810b5d47bd3d None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:44.734635 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:44.847846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d48486-78f0-457e-9442-810b5d47bd3d None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:44.889759 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302da59-1d5a-4e80-951f-c3f43c8f1b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:44.890639 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302da59-1d5a-4e80-951f-c3f43c8f1b01 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:44.890989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302da59-1d5a-4e80-951f-c3f43c8f1b01 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:44.891289 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302da59-1d5a-4e80-951f-c3f43c8f1b01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:44.898992 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302da59-1d5a-4e80-951f-c3f43c8f1b01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:44.900577 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302da59-1d5a-4e80-951f-c3f43c8f1b01 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-0302da59-1d5a-4e80-951f-c3f43c8f1b01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:44:44.916815 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:44.918513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:44.919413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:44:44.919413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:44:44.919413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:44:44.919413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:44:44.919413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:44:44.919413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:44:44.919413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:44:44.919413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:44.919413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 432/851] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:44.924837 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c534257-b1e0-4342-90ae-ba37aa17c0af None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:45.035057 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c534257-b1e0-4342-90ae-ba37aa17c0af None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:45.069738 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf2806-9517-469e-b38e-70a8d4ddacb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:45.070481 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf2806-9517-469e-b38e-70a8d4ddacb8 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:45.070760 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf2806-9517-469e-b38e-70a8d4ddacb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:45.071033 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf2806-9517-469e-b38e-70a8d4ddacb8 None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:45.071804 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf2806-9517-469e-b38e-70a8d4ddacb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:45.072130 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf2806-9517-469e-b38e-70a8d4ddacb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:45.074004 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf2806-9517-469e-b38e-70a8d4ddacb8 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:45.087294 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 420/852] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:44:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:44:45.094001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302da59-1d5a-4e80-951f-c3f43c8f1b01 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:45.164468 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:45.205976 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302da59-1d5a-4e80-951f-c3f43c8f1b01 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:45.241955 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d490fe-0465-435e-9720-d245a3682864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:45.242840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d490fe-0465-435e-9720-d245a3682864 None admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:45.243125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d490fe-0465-435e-9720-d245a3682864 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:45.243406 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d490fe-0465-435e-9720-d245a3682864 None admin] PATH_INFO: `/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/ce92f306929849f98a89e3dadb26cb37/roles/5d30b117c7cb45a6ae69d3f19986213d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:45.257837 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d490fe-0465-435e-9720-d245a3682864 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae279b6ea9b04682832e4f2aaf4f9a00, user_id=ce92f306929849f98a89e3dadb26cb37, role_id=5d30b117c7cb45a6ae69d3f19986213d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:45.259281 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d490fe-0465-435e-9720-d245a3682864 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:45.274443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 433/853] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:44:45 2022] PUT /identity/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/ce92f306929849f98a89e3dadb26cb37/roles/5d30b117c7cb45a6ae69d3f19986213d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:44:47.675146 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dcc7-002f-489c-87ee-68e648ea8ea7 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:47.675708 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dcc7-002f-489c-87ee-68e648ea8ea7 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:47.675708 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dcc7-002f-489c-87ee-68e648ea8ea7 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:47.677079 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 421/854] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:44:47.682956 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7ab63-f642-4cf4-ab15-70b80452cf93 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:47.683970 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7ab63-f642-4cf4-ab15-70b80452cf93 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:47.684075 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7ab63-f642-4cf4-ab15-70b80452cf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:47.702318 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-52e7ab63-f642-4cf4-ab15-70b80452cf93 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:44:47.703629 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-52e7ab63-f642-4cf4-ab15-70b80452cf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:47.781621 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 434/855] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:44:47 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:44:47.808317 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5dcc7-002f-489c-87ee-68e648ea8ea7 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:47.834802 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:47.922129 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5dcc7-002f-489c-87ee-68e648ea8ea7 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:47.960163 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649471e-2f98-48d9-b290-2f567cc4071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:47.960883 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649471e-2f98-48d9-b290-2f567cc4071b None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:47.961159 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649471e-2f98-48d9-b290-2f567cc4071b None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:47.961465 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1649471e-2f98-48d9-b290-2f567cc4071b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:47.973401 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1649471e-2f98-48d9-b290-2f567cc4071b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-1649471e-2f98-48d9-b290-2f567cc4071b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:44:47.983439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:47.984759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:47.985664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 422/856] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Jul 12 18:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:47.991480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7ab63-f642-4cf4-ab15-70b80452cf93 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:48.043434 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:48.108719 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e7ab63-f642-4cf4-ab15-70b80452cf93 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:48.146567 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fa1bc-f7c6-4ac4-bff2-d7763a9c5dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:48.147267 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa1bc-f7c6-4ac4-bff2-d7763a9c5dd9 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:48.147559 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa1bc-f7c6-4ac4-bff2-d7763a9c5dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:48.147905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fa1bc-f7c6-4ac4-bff2-d7763a9c5dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:48.148680 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fa1bc-f7c6-4ac4-bff2-d7763a9c5dd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:48.148983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fa1bc-f7c6-4ac4-bff2-d7763a9c5dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:48.150479 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fa1bc-f7c6-4ac4-bff2-d7763a9c5dd9 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:48.159813 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 435/857] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Jul 12 18:44:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:44:48.165932 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649471e-2f98-48d9-b290-2f567cc4071b None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:48.259390 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:48.277993 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1649471e-2f98-48d9-b290-2f567cc4071b None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:48.317388 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76e9c1-1043-473e-b9e4-3e1c006f3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:48.318400 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76e9c1-1043-473e-b9e4-3e1c006f3160 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:48.318663 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76e9c1-1043-473e-b9e4-3e1c006f3160 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:48.319016 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76e9c1-1043-473e-b9e4-3e1c006f3160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:48.330854 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76e9c1-1043-473e-b9e4-3e1c006f3160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:48.332338 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76e9c1-1043-473e-b9e4-3e1c006f3160 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-2d76e9c1-1043-473e-b9e4-3e1c006f3160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:48.350276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:48.351525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:48.352678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:48.352678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:48.352678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:48.352678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:48.352678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 423/858] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:48.358444 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fa1bc-f7c6-4ac4-bff2-d7763a9c5dd9 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:48.464144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fa1bc-f7c6-4ac4-bff2-d7763a9c5dd9 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:48.467137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:48.504024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830937-efde-4fab-82fe-baedde6db987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:48.504749 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830937-efde-4fab-82fe-baedde6db987 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:48.505077 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830937-efde-4fab-82fe-baedde6db987 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:48.505392 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830937-efde-4fab-82fe-baedde6db987 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:48.506117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830937-efde-4fab-82fe-baedde6db987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:48.506432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830937-efde-4fab-82fe-baedde6db987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:48.507856 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830937-efde-4fab-82fe-baedde6db987 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:48.521213 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 436/859] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:48.526772 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76e9c1-1043-473e-b9e4-3e1c006f3160 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:48.638280 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76e9c1-1043-473e-b9e4-3e1c006f3160 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:48.676455 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89732440-d3f0-471a-83b9-bb7a24c594d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:48.677276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89732440-d3f0-471a-83b9-bb7a24c594d8 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:48.677662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89732440-d3f0-471a-83b9-bb7a24c594d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:48.678013 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89732440-d3f0-471a-83b9-bb7a24c594d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:48.681088 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:48.686759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89732440-d3f0-471a-83b9-bb7a24c594d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:48.688603 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89732440-d3f0-471a-83b9-bb7a24c594d8 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-89732440-d3f0-471a-83b9-bb7a24c594d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:44:48.704186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:48.705536 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:48.706637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 424/860] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:48.712743 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830937-efde-4fab-82fe-baedde6db987 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:48.823040 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830937-efde-4fab-82fe-baedde6db987 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:48.865115 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e091b4-7d7e-4ac4-8d51-8c1d2abcc40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:48.866255 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e091b4-7d7e-4ac4-8d51-8c1d2abcc40f None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:48.866712 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e091b4-7d7e-4ac4-8d51-8c1d2abcc40f None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:48.867000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e091b4-7d7e-4ac4-8d51-8c1d2abcc40f None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:48.867979 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e091b4-7d7e-4ac4-8d51-8c1d2abcc40f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:48.868137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e091b4-7d7e-4ac4-8d51-8c1d2abcc40f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:48.869599 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e091b4-7d7e-4ac4-8d51-8c1d2abcc40f None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:48.893050 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 437/861] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Jul 12 18:44:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:48.899202 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89732440-d3f0-471a-83b9-bb7a24c594d8 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:49.009155 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89732440-d3f0-471a-83b9-bb7a24c594d8 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:49.046873 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860ed5f-c591-461b-b465-57e7694aba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:49.047524 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ed5f-c591-461b-b465-57e7694aba67 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:49.047822 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ed5f-c591-461b-b465-57e7694aba67 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:49.048171 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860ed5f-c591-461b-b465-57e7694aba67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:49.117043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:49.125379 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860ed5f-c591-461b-b465-57e7694aba67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:49.126856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860ed5f-c591-461b-b465-57e7694aba67 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:49.231228 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 425/862] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:44:48 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:44:49.238207 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e091b4-7d7e-4ac4-8d51-8c1d2abcc40f None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:49.266449 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:49.348769 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e091b4-7d7e-4ac4-8d51-8c1d2abcc40f None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:49.392014 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67a1dc-c27f-44ef-8e59-4ed2030f108a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:49.392726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a1dc-c27f-44ef-8e59-4ed2030f108a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:49.393005 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a1dc-c27f-44ef-8e59-4ed2030f108a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:49.393356 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a1dc-c27f-44ef-8e59-4ed2030f108a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:49.403070 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67a1dc-c27f-44ef-8e59-4ed2030f108a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:49.404494 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67a1dc-c27f-44ef-8e59-4ed2030f108a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-7c67a1dc-c27f-44ef-8e59-4ed2030f108a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:49.423071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:49.424216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:49.425369 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:49.425369 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:49.425369 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:49.425369 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:49.425605 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 438/863] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:49.430153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860ed5f-c591-461b-b465-57e7694aba67 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:49.540998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:49.547235 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860ed5f-c591-461b-b465-57e7694aba67 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:49.587860 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56e6c3-c542-49e9-84f7-919683f1ffc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:49.588539 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e6c3-c542-49e9-84f7-919683f1ffc3 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:49.588794 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e6c3-c542-49e9-84f7-919683f1ffc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:49.589172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d56e6c3-c542-49e9-84f7-919683f1ffc3 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:49.589851 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e6c3-c542-49e9-84f7-919683f1ffc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:49.590192 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e6c3-c542-49e9-84f7-919683f1ffc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:49.591541 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d56e6c3-c542-49e9-84f7-919683f1ffc3 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:49.604066 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 426/864] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:49.610383 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67a1dc-c27f-44ef-8e59-4ed2030f108a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:49.696417 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:49.726691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67a1dc-c27f-44ef-8e59-4ed2030f108a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:49.764460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728878fb-dfea-49c2-a6b2-42a9d28a10f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:49.765252 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728878fb-dfea-49c2-a6b2-42a9d28a10f3 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:49.765553 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728878fb-dfea-49c2-a6b2-42a9d28a10f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:49.765829 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728878fb-dfea-49c2-a6b2-42a9d28a10f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:49.773396 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728878fb-dfea-49c2-a6b2-42a9d28a10f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:49.774923 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728878fb-dfea-49c2-a6b2-42a9d28a10f3 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-728878fb-dfea-49c2-a6b2-42a9d28a10f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:44:49.790266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:49.791351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:49.792443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:44:49.792443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:44:49.792443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:44:49.792443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:44:49.792443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:44:49.792443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:44:49.792443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:44:49.792443 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:49.797022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 439/865] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:44:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:49.797934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56e6c3-c542-49e9-84f7-919683f1ffc3 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:49.909419 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d56e6c3-c542-49e9-84f7-919683f1ffc3 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:49.951855 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae756936-97af-410d-9eb2-54150a35ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:49.952469 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae756936-97af-410d-9eb2-54150a35ab46 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:49.952830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae756936-97af-410d-9eb2-54150a35ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:49.953158 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae756936-97af-410d-9eb2-54150a35ab46 None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:49.954020 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae756936-97af-410d-9eb2-54150a35ab46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:49.954350 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae756936-97af-410d-9eb2-54150a35ab46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:49.955861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae756936-97af-410d-9eb2-54150a35ab46 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:49.970043 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 427/866] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:44:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:49.976103 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728878fb-dfea-49c2-a6b2-42a9d28a10f3 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:50.083305 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728878fb-dfea-49c2-a6b2-42a9d28a10f3 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:50.121980 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1943a5-8994-4c9b-b1b6-004ed405c4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:50.122703 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1943a5-8994-4c9b-b1b6-004ed405c4d9 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:50.122928 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1943a5-8994-4c9b-b1b6-004ed405c4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:50.123214 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1943a5-8994-4c9b-b1b6-004ed405c4d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:50.124032 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1943a5-8994-4c9b-b1b6-004ed405c4d9 None admin] RBAC: Adding query filter params (role.id=5d30b117c7cb45a6ae69d3f19986213d, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=ce92f306929849f98a89e3dadb26cb37) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:50.124356 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1943a5-8994-4c9b-b1b6-004ed405c4d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:50.125888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1943a5-8994-4c9b-b1b6-004ed405c4d9 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:50.127784 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:50.133358 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 440/867] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:44:49 2022] GET /identity/v3/role_assignments?user.id=ce92f306929849f98a89e3dadb26cb37&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=5d30b117c7cb45a6ae69d3f19986213d => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:52.516606 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f147c1-125f-4bee-ab21-cb78a3792be5 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:52.517150 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f147c1-125f-4bee-ab21-cb78a3792be5 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:52.517238 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f147c1-125f-4bee-ab21-cb78a3792be5 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:52.518832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 428/868] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:44:52.524115 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d97ad7-6474-43cb-bfde-3c76b5c15dab None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:52.524558 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d97ad7-6474-43cb-bfde-3c76b5c15dab None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:52.524648 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d97ad7-6474-43cb-bfde-3c76b5c15dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:52.541524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-81d97ad7-6474-43cb-bfde-3c76b5c15dab None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:44:52.542720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-81d97ad7-6474-43cb-bfde-3c76b5c15dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:52.617979 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 441/869] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:44:52 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:44:52.650363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f147c1-125f-4bee-ab21-cb78a3792be5 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:52.670187 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:52.759369 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f147c1-125f-4bee-ab21-cb78a3792be5 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:52.798726 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55122b-218a-4bfb-90a7-2fa2046b8294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:52.799448 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55122b-218a-4bfb-90a7-2fa2046b8294 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:52.799730 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55122b-218a-4bfb-90a7-2fa2046b8294 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:52.800072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55122b-218a-4bfb-90a7-2fa2046b8294 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:52.811273 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55122b-218a-4bfb-90a7-2fa2046b8294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-4a55122b-218a-4bfb-90a7-2fa2046b8294 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:44:52.818887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:52.819882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:52.820903 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 429/870] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:44:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:44:52.826909 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d97ad7-6474-43cb-bfde-3c76b5c15dab None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:52.948959 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d97ad7-6474-43cb-bfde-3c76b5c15dab None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:52.976625 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:52.986099 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedb3df-de6f-4e79-b895-63f3f6b60c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:52.986771 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedb3df-de6f-4e79-b895-63f3f6b60c5a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:52.987110 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedb3df-de6f-4e79-b895-63f3f6b60c5a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:52.987499 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedb3df-de6f-4e79-b895-63f3f6b60c5a None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:52.988398 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedb3df-de6f-4e79-b895-63f3f6b60c5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:52.988711 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedb3df-de6f-4e79-b895-63f3f6b60c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:52.990216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedb3df-de6f-4e79-b895-63f3f6b60c5a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:52.999520 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 442/871] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:44:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:53.005571 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55122b-218a-4bfb-90a7-2fa2046b8294 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:53.092567 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:53.116913 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55122b-218a-4bfb-90a7-2fa2046b8294 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:53.154834 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fe0f3-f426-42c4-a2e9-b74fc065c5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:53.156389 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fe0f3-f426-42c4-a2e9-b74fc065c5dd None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:53.156740 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fe0f3-f426-42c4-a2e9-b74fc065c5dd None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:53.157252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fe0f3-f426-42c4-a2e9-b74fc065c5dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:53.172232 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fe0f3-f426-42c4-a2e9-b74fc065c5dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:53.173716 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fe0f3-f426-42c4-a2e9-b74fc065c5dd None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-080fe0f3-f426-42c4-a2e9-b74fc065c5dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:53.190861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:53.192109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:53.193007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:53.193007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:53.193007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:53.193007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:53.193007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 430/872] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:53.198256 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedb3df-de6f-4e79-b895-63f3f6b60c5a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:53.303570 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedb3df-de6f-4e79-b895-63f3f6b60c5a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:53.339988 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36606331-f43b-4120-b4f2-8d36517e2607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:53.340697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36606331-f43b-4120-b4f2-8d36517e2607 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:53.341012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36606331-f43b-4120-b4f2-8d36517e2607 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:53.341378 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36606331-f43b-4120-b4f2-8d36517e2607 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:53.342159 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36606331-f43b-4120-b4f2-8d36517e2607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:53.342523 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36606331-f43b-4120-b4f2-8d36517e2607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:53.344091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36606331-f43b-4120-b4f2-8d36517e2607 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:53.357750 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 443/873] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:53.364216 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fe0f3-f426-42c4-a2e9-b74fc065c5dd None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:53.469870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fe0f3-f426-42c4-a2e9-b74fc065c5dd None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:53.499090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:53.508782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bd9a0-cd65-4bae-8491-ab7115c48962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:53.509746 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bd9a0-cd65-4bae-8491-ab7115c48962 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:53.510094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bd9a0-cd65-4bae-8491-ab7115c48962 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:53.510404 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bd9a0-cd65-4bae-8491-ab7115c48962 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:53.519635 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bd9a0-cd65-4bae-8491-ab7115c48962 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:53.521120 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32bd9a0-cd65-4bae-8491-ab7115c48962 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-d32bd9a0-cd65-4bae-8491-ab7115c48962 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:44:53.537026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:53.538295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:53.545486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 431/874] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:53.546186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36606331-f43b-4120-b4f2-8d36517e2607 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:53.614923 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:53.670831 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36606331-f43b-4120-b4f2-8d36517e2607 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:53.706278 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986800b-6de6-4f8a-8a25-75be3cd3e383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:53.706960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986800b-6de6-4f8a-8a25-75be3cd3e383 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:53.707246 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986800b-6de6-4f8a-8a25-75be3cd3e383 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:53.707529 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986800b-6de6-4f8a-8a25-75be3cd3e383 None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:53.708360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986800b-6de6-4f8a-8a25-75be3cd3e383 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:53.708668 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986800b-6de6-4f8a-8a25-75be3cd3e383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:53.710135 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986800b-6de6-4f8a-8a25-75be3cd3e383 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:53.729622 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 444/875] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Jul 12 18:44:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:53.735480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bd9a0-cd65-4bae-8491-ab7115c48962 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:53.840259 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32bd9a0-cd65-4bae-8491-ab7115c48962 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:53.876761 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3056a-7c36-4e8f-8071-defaba53e06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:53.877363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3056a-7c36-4e8f-8071-defaba53e06d None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:53.877652 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3056a-7c36-4e8f-8071-defaba53e06d None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:53.877930 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3056a-7c36-4e8f-8071-defaba53e06d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:53.937274 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:53.950639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3056a-7c36-4e8f-8071-defaba53e06d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:53.952079 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3056a-7c36-4e8f-8071-defaba53e06d None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:54.048511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 432/876] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:44:53 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:44:54.054264 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986800b-6de6-4f8a-8a25-75be3cd3e383 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:54.154194 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986800b-6de6-4f8a-8a25-75be3cd3e383 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:54.163772 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:54.191286 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e01e-0571-4767-9303-c16f28da16d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:54.192069 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e01e-0571-4767-9303-c16f28da16d5 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:54.192347 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e01e-0571-4767-9303-c16f28da16d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:54.192623 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171e01e-0571-4767-9303-c16f28da16d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:54.202712 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171e01e-0571-4767-9303-c16f28da16d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:54.204127 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c171e01e-0571-4767-9303-c16f28da16d5 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-c171e01e-0571-4767-9303-c16f28da16d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:54.220987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:54.222141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:54.223489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:54.223489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:54.223489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:54.223489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:54.223489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 445/877] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:54.227822 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3056a-7c36-4e8f-8071-defaba53e06d None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:54.313521 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:54.325170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3056a-7c36-4e8f-8071-defaba53e06d None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:54.357523 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e12ec-16ff-49a5-b278-42a8ebc72049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:54.358172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e12ec-16ff-49a5-b278-42a8ebc72049 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:54.358454 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e12ec-16ff-49a5-b278-42a8ebc72049 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:54.358730 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e12ec-16ff-49a5-b278-42a8ebc72049 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:54.359439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e12ec-16ff-49a5-b278-42a8ebc72049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:54.359742 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e12ec-16ff-49a5-b278-42a8ebc72049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:54.361093 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e12ec-16ff-49a5-b278-42a8ebc72049 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:54.372410 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 433/878] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:54.377898 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e01e-0571-4767-9303-c16f28da16d5 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:54.474054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c171e01e-0571-4767-9303-c16f28da16d5 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:54.507356 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178a6d2-2539-4212-afad-c8829f56b59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:54.508121 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a6d2-2539-4212-afad-c8829f56b59a None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:54.508405 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a6d2-2539-4212-afad-c8829f56b59a None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:54.508683 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a6d2-2539-4212-afad-c8829f56b59a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:54.515196 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178a6d2-2539-4212-afad-c8829f56b59a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:54.516613 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178a6d2-2539-4212-afad-c8829f56b59a None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-e178a6d2-2539-4212-afad-c8829f56b59a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:44:54.530910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:54.531921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:54.532960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:44:54.532960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:44:54.532960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:44:54.532960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:44:54.532960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:44:54.532960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:44:54.532960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:44:54.532960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:44:54.532960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 446/879] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:54.537591 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e12ec-16ff-49a5-b278-42a8ebc72049 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:54.642681 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e12ec-16ff-49a5-b278-42a8ebc72049 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:54.675654 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8769f57-dce7-45ae-9226-aaa7924296d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:54.676304 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8769f57-dce7-45ae-9226-aaa7924296d6 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:54.676587 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8769f57-dce7-45ae-9226-aaa7924296d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:54.676867 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8769f57-dce7-45ae-9226-aaa7924296d6 None admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:54.677678 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8769f57-dce7-45ae-9226-aaa7924296d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:54.677985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8769f57-dce7-45ae-9226-aaa7924296d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:54.679406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8769f57-dce7-45ae-9226-aaa7924296d6 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:54.691044 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 434/880] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:54.697069 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178a6d2-2539-4212-afad-c8829f56b59a None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:54.719377 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:54.793885 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178a6d2-2539-4212-afad-c8829f56b59a None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:54.826284 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e359a-2ca1-4bc5-8ccc-d591170ee099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:54.826920 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e359a-2ca1-4bc5-8ccc-d591170ee099 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:54.827203 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e359a-2ca1-4bc5-8ccc-d591170ee099 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:54.827481 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e359a-2ca1-4bc5-8ccc-d591170ee099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:54.828293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e359a-2ca1-4bc5-8ccc-d591170ee099 None admin] RBAC: Adding query filter params (role.id=948b82ff28c547e78755c196cddfdd0e, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=ce92f306929849f98a89e3dadb26cb37) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:54.828606 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e359a-2ca1-4bc5-8ccc-d591170ee099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:54.830060 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e359a-2ca1-4bc5-8ccc-d591170ee099 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:54.835336 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 447/881] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:44:54 2022] GET /identity/v3/role_assignments?user.id=ce92f306929849f98a89e3dadb26cb37&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=948b82ff28c547e78755c196cddfdd0e => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:57.027412 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed567e-9d93-4c67-af60-c4610d35a222 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:57.027965 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed567e-9d93-4c67-af60-c4610d35a222 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:57.027965 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed567e-9d93-4c67-af60-c4610d35a222 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:57.029343 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 435/882] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:44:57.034655 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c12cc-1c6d-4c40-ba69-a1b0c2fee131 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:57.035086 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c12cc-1c6d-4c40-ba69-a1b0c2fee131 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:57.035240 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c12cc-1c6d-4c40-ba69-a1b0c2fee131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:57.052658 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-ec5c12cc-1c6d-4c40-ba69-a1b0c2fee131 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:44:57.053862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-ec5c12cc-1c6d-4c40-ba69-a1b0c2fee131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:44:57.124303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 448/883] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:44:57 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:44:57.148432 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed567e-9d93-4c67-af60-c4610d35a222 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:57.159762 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:57.251075 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed567e-9d93-4c67-af60-c4610d35a222 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:57.284367 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a38616-749b-4642-9889-dd20ba10a534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:57.285141 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a38616-749b-4642-9889-dd20ba10a534 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:57.285458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a38616-749b-4642-9889-dd20ba10a534 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:57.285739 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a38616-749b-4642-9889-dd20ba10a534 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:57.296046 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a38616-749b-4642-9889-dd20ba10a534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-b3a38616-749b-4642-9889-dd20ba10a534 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:44:57.303559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:57.304636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:57.305766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 436/884] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:44:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:57.310912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c12cc-1c6d-4c40-ba69-a1b0c2fee131 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:57.325444 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:57.405077 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c12cc-1c6d-4c40-ba69-a1b0c2fee131 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:57.438576 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861a716-3c02-44ca-a709-dc490582cf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:57.439221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861a716-3c02-44ca-a709-dc490582cf3d None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:57.439500 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861a716-3c02-44ca-a709-dc490582cf3d None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:57.439773 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861a716-3c02-44ca-a709-dc490582cf3d None admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:57.440493 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861a716-3c02-44ca-a709-dc490582cf3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:57.440792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861a716-3c02-44ca-a709-dc490582cf3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:57.442171 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861a716-3c02-44ca-a709-dc490582cf3d None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:57.450350 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 449/885] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:44:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:57.456079 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a38616-749b-4642-9889-dd20ba10a534 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:57.519885 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:57.552625 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a38616-749b-4642-9889-dd20ba10a534 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:57.588456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9ffe5-7001-41ad-81a8-68526010c20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:57.589448 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ffe5-7001-41ad-81a8-68526010c20e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:57.589719 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ffe5-7001-41ad-81a8-68526010c20e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:57.590060 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9ffe5-7001-41ad-81a8-68526010c20e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:57.601906 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9ffe5-7001-41ad-81a8-68526010c20e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:57.603375 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9ffe5-7001-41ad-81a8-68526010c20e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-27f9ffe5-7001-41ad-81a8-68526010c20e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:57.623475 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:57.624662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:57.625847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:57.625847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:57.625847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:57.625847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:57.625847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 437/886] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:57.631341 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861a716-3c02-44ca-a709-dc490582cf3d None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:57.708573 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:57.731425 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861a716-3c02-44ca-a709-dc490582cf3d None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:57.763386 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1171-1d96-473b-9851-07c4cf6f39b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:57.764029 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1171-1d96-473b-9851-07c4cf6f39b8 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:57.764308 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1171-1d96-473b-9851-07c4cf6f39b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:57.764581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b1171-1d96-473b-9851-07c4cf6f39b8 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:57.765306 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b1171-1d96-473b-9851-07c4cf6f39b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:57.765615 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b1171-1d96-473b-9851-07c4cf6f39b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:57.766955 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b1171-1d96-473b-9851-07c4cf6f39b8 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:57.778077 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 450/887] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:57.784000 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9ffe5-7001-41ad-81a8-68526010c20e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:57.880142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9ffe5-7001-41ad-81a8-68526010c20e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:57.898866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:57.914037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662c34d-7489-42dc-b300-99063110e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:57.914828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c34d-7489-42dc-b300-99063110e09e None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:57.915108 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c34d-7489-42dc-b300-99063110e09e None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:57.915382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c34d-7489-42dc-b300-99063110e09e None admin] PATH_INFO: `/v3/users/placement` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:57.923120 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662c34d-7489-42dc-b300-99063110e09e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:57.924539 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662c34d-7489-42dc-b300-99063110e09e None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-3662c34d-7489-42dc-b300-99063110e09e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:44:57.938279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:57.939373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:57.940545 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 438/888] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:57.945273 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1171-1d96-473b-9851-07c4cf6f39b8 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:58.039079 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b1171-1d96-473b-9851-07c4cf6f39b8 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:58.070969 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4057dd-18f2-4c1b-a1cb-5927af3dedcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:58.071607 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4057dd-18f2-4c1b-a1cb-5927af3dedcc None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:58.071887 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4057dd-18f2-4c1b-a1cb-5927af3dedcc None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:58.072160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4057dd-18f2-4c1b-a1cb-5927af3dedcc None admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:58.072967 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4057dd-18f2-4c1b-a1cb-5927af3dedcc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:58.073271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4057dd-18f2-4c1b-a1cb-5927af3dedcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:58.074728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4057dd-18f2-4c1b-a1cb-5927af3dedcc None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:58.077160 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:58.092077 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 451/889] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Jul 12 18:44:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:58.097632 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662c34d-7489-42dc-b300-99063110e09e None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:58.198838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662c34d-7489-42dc-b300-99063110e09e None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:58.237192 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91aed-b66d-4b53-8047-8c7ddf5065aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:58.238009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91aed-b66d-4b53-8047-8c7ddf5065aa None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:58.238287 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91aed-b66d-4b53-8047-8c7ddf5065aa None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:58.238556 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91aed-b66d-4b53-8047-8c7ddf5065aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:58.248830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91aed-b66d-4b53-8047-8c7ddf5065aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:58.250283 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca91aed-b66d-4b53-8047-8c7ddf5065aa None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-eca91aed-b66d-4b53-8047-8c7ddf5065aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:44:58.266573 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:58.267575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:58.268562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:44:58.268562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:44:58.268562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:44:58.268562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:58.268562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 439/890] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:58.273594 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4057dd-18f2-4c1b-a1cb-5927af3dedcc None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:58.368745 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4057dd-18f2-4c1b-a1cb-5927af3dedcc None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:58.400517 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540975f3-96ef-4ed6-a7bb-e5023843878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:58.401154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540975f3-96ef-4ed6-a7bb-e5023843878d None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:58.401464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540975f3-96ef-4ed6-a7bb-e5023843878d None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:58.402325 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540975f3-96ef-4ed6-a7bb-e5023843878d None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:58.403030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540975f3-96ef-4ed6-a7bb-e5023843878d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:58.403332 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540975f3-96ef-4ed6-a7bb-e5023843878d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:58.404662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540975f3-96ef-4ed6-a7bb-e5023843878d None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:58.415575 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 452/891] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:58.420988 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91aed-b66d-4b53-8047-8c7ddf5065aa None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:58.451897 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:58.518011 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91aed-b66d-4b53-8047-8c7ddf5065aa None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:58.550257 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0c55f-7953-4d71-ab73-0d3d12f66b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:58.551032 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0c55f-7953-4d71-ab73-0d3d12f66b2c None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:58.551312 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0c55f-7953-4d71-ab73-0d3d12f66b2c None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:58.551584 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0c55f-7953-4d71-ab73-0d3d12f66b2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:58.558027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0c55f-7953-4d71-ab73-0d3d12f66b2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:58.559439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0c55f-7953-4d71-ab73-0d3d12f66b2c None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-61b0c55f-7953-4d71-ab73-0d3d12f66b2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:44:58.574579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:44:58.575609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:44:58.576821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:44:58.576821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:44:58.576821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:44:58.576821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:44:58.576821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:44:58.576821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:44:58.576821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:44:58.576821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:44:58.576821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 440/892] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:44:58.581466 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540975f3-96ef-4ed6-a7bb-e5023843878d None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:58.637064 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:58.680127 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540975f3-96ef-4ed6-a7bb-e5023843878d None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:58.712707 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f7370-9e40-47f8-96d1-d6668b2315c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:58.713377 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7370-9e40-47f8-96d1-d6668b2315c7 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:58.713660 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7370-9e40-47f8-96d1-d6668b2315c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:58.713932 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f7370-9e40-47f8-96d1-d6668b2315c7 None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:58.714697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f7370-9e40-47f8-96d1-d6668b2315c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:44:58.715001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f7370-9e40-47f8-96d1-d6668b2315c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:58.716406 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f7370-9e40-47f8-96d1-d6668b2315c7 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:58.727842 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 453/893] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:44:58.733835 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0c55f-7953-4d71-ab73-0d3d12f66b2c None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:44:58.822572 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:44:58.832056 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0c55f-7953-4d71-ab73-0d3d12f66b2c None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:44:58.864677 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e51250-20fe-4667-96c3-b13bb95ee952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:44:58.865583 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51250-20fe-4667-96c3-b13bb95ee952 None admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:44:58.865861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51250-20fe-4667-96c3-b13bb95ee952 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:44:58.866134 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e51250-20fe-4667-96c3-b13bb95ee952 None admin] PATH_INFO: `/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/ce92f306929849f98a89e3dadb26cb37/roles/948b82ff28c547e78755c196cddfdd0e` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:44:58.868029 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e51250-20fe-4667-96c3-b13bb95ee952 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae279b6ea9b04682832e4f2aaf4f9a00, user_id=ce92f306929849f98a89e3dadb26cb37, role_id=948b82ff28c547e78755c196cddfdd0e)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:44:58.869474 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e51250-20fe-4667-96c3-b13bb95ee952 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:44:58.882295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 441/894] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Jul 12 18:44:58 2022] PUT /identity/v3/projects/ae279b6ea9b04682832e4f2aaf4f9a00/users/ce92f306929849f98a89e3dadb26cb37/roles/948b82ff28c547e78755c196cddfdd0e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:45:01.088883 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fad36-30dc-4232-9c6c-2fb585d7fa3e None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:01.089953 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fad36-30dc-4232-9c6c-2fb585d7fa3e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:01.090042 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fad36-30dc-4232-9c6c-2fb585d7fa3e None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:01.091334 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 454/895] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:45:01.096353 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533812-50e4-4ede-88ab-72d9ea5af81e None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:01.096783 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533812-50e4-4ede-88ab-72d9ea5af81e None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:01.096902 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07533812-50e4-4ede-88ab-72d9ea5af81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:01.113683 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-07533812-50e4-4ede-88ab-72d9ea5af81e None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:45:01.114847 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-07533812-50e4-4ede-88ab-72d9ea5af81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:45:01.178452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 442/896] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:45:01 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:45:01.202719 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fad36-30dc-4232-9c6c-2fb585d7fa3e None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:01.301726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fad36-30dc-4232-9c6c-2fb585d7fa3e None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:01.315024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:01.335810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f9bb2-82f1-49cf-8a5e-2c83a4ea2134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:01.336583 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f9bb2-82f1-49cf-8a5e-2c83a4ea2134 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:01.336865 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f9bb2-82f1-49cf-8a5e-2c83a4ea2134 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:01.337144 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f9bb2-82f1-49cf-8a5e-2c83a4ea2134 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:01.347347 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f9bb2-82f1-49cf-8a5e-2c83a4ea2134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-333f9bb2-82f1-49cf-8a5e-2c83a4ea2134 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:45:01.354934 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:45:01.355997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:01.357188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 455/897] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Jul 12 18:45:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:45:01.362118 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533812-50e4-4ede-88ab-72d9ea5af81e None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:01.438963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:01.457870 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07533812-50e4-4ede-88ab-72d9ea5af81e None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:01.490256 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575ec40-2edb-4348-b71c-18b36aeac3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:01.490909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575ec40-2edb-4348-b71c-18b36aeac3fd None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:01.491193 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575ec40-2edb-4348-b71c-18b36aeac3fd None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:01.491470 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575ec40-2edb-4348-b71c-18b36aeac3fd None admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:01.492201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575ec40-2edb-4348-b71c-18b36aeac3fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:01.492505 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575ec40-2edb-4348-b71c-18b36aeac3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:01.493889 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575ec40-2edb-4348-b71c-18b36aeac3fd None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:01.501735 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 443/898] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Jul 12 18:45:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:01.507236 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f9bb2-82f1-49cf-8a5e-2c83a4ea2134 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:01.613105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f9bb2-82f1-49cf-8a5e-2c83a4ea2134 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:01.649475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2305f0-3f5a-4f2d-902d-367a15030cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:01.650258 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2305f0-3f5a-4f2d-902d-367a15030cf2 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:01.650540 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2305f0-3f5a-4f2d-902d-367a15030cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:01.650817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2305f0-3f5a-4f2d-902d-367a15030cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:01.662266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2305f0-3f5a-4f2d-902d-367a15030cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:01.663715 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2305f0-3f5a-4f2d-902d-367a15030cf2 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-3d2305f0-3f5a-4f2d-902d-367a15030cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:45:01.680374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:45:01.681470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:45:01.682435 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:45:01.682435 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:45:01.682435 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:45:01.682435 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:01.682435 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 456/899] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:45:01.688400 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575ec40-2edb-4348-b71c-18b36aeac3fd None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:01.783661 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575ec40-2edb-4348-b71c-18b36aeac3fd None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:01.815443 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad3004-cb53-44b5-868e-3775c59b50f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:01.816082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3004-cb53-44b5-868e-3775c59b50f2 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:01.816365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3004-cb53-44b5-868e-3775c59b50f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:01.816639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3004-cb53-44b5-868e-3775c59b50f2 None admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:01.817373 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad3004-cb53-44b5-868e-3775c59b50f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:01.817684 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad3004-cb53-44b5-868e-3775c59b50f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:01.819039 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad3004-cb53-44b5-868e-3775c59b50f2 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:01.830845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 444/900] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:01.837264 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2305f0-3f5a-4f2d-902d-367a15030cf2 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:01.863952 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:01.934616 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2305f0-3f5a-4f2d-902d-367a15030cf2 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:01.966709 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cad9aa-04d9-4c55-9dfd-c3c635806f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:01.967606 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cad9aa-04d9-4c55-9dfd-c3c635806f14 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:01.967923 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cad9aa-04d9-4c55-9dfd-c3c635806f14 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:01.968366 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cad9aa-04d9-4c55-9dfd-c3c635806f14 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:01.976167 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cad9aa-04d9-4c55-9dfd-c3c635806f14 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:01.977625 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cad9aa-04d9-4c55-9dfd-c3c635806f14 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-d3cad9aa-04d9-4c55-9dfd-c3c635806f14 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:45:01.991571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:45:01.992646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:01.994037 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 457/901] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:45:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:45:01.999581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad3004-cb53-44b5-868e-3775c59b50f2 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:02.003470 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:02.096585 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad3004-cb53-44b5-868e-3775c59b50f2 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:02.129916 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6197a4-5fe3-4bc3-9596-221a5c636c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:02.130575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6197a4-5fe3-4bc3-9596-221a5c636c83 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:02.130866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6197a4-5fe3-4bc3-9596-221a5c636c83 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:02.131141 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6197a4-5fe3-4bc3-9596-221a5c636c83 None admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:02.131957 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6197a4-5fe3-4bc3-9596-221a5c636c83 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:02.132265 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6197a4-5fe3-4bc3-9596-221a5c636c83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:02.133709 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6197a4-5fe3-4bc3-9596-221a5c636c83 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:02.151437 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 445/902] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Jul 12 18:45:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:02.157823 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cad9aa-04d9-4c55-9dfd-c3c635806f14 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:02.242337 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:02.256833 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cad9aa-04d9-4c55-9dfd-c3c635806f14 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:02.289656 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496eb3f-846a-41de-aafb-bf44dc8c2b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:02.290291 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496eb3f-846a-41de-aafb-bf44dc8c2b0e None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:02.290573 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496eb3f-846a-41de-aafb-bf44dc8c2b0e None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:02.290850 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496eb3f-846a-41de-aafb-bf44dc8c2b0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:02.356697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496eb3f-846a-41de-aafb-bf44dc8c2b0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:02.358083 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496eb3f-846a-41de-aafb-bf44dc8c2b0e None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:02.436528 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:02.452308 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 458/903] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Jul 12 18:45:02 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:45:02.458073 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6197a4-5fe3-4bc3-9596-221a5c636c83 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:02.516962 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:02.553443 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6197a4-5fe3-4bc3-9596-221a5c636c83 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:02.590664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87d18b-e3ad-4e5f-9024-f5afb67b6afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:02.591567 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87d18b-e3ad-4e5f-9024-f5afb67b6afa None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:02.591976 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87d18b-e3ad-4e5f-9024-f5afb67b6afa None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:02.592161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87d18b-e3ad-4e5f-9024-f5afb67b6afa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:02.602350 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87d18b-e3ad-4e5f-9024-f5afb67b6afa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:02.603798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87d18b-e3ad-4e5f-9024-f5afb67b6afa None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-1d87d18b-e3ad-4e5f-9024-f5afb67b6afa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:45:02.625347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:45:02.626206 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:45:02.627112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:45:02.627112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:45:02.627112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:45:02.627112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:45:02.627112 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 446/904] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:45:02.632116 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496eb3f-846a-41de-aafb-bf44dc8c2b0e None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:02.728131 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496eb3f-846a-41de-aafb-bf44dc8c2b0e None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:02.760811 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8f8bb-b274-441c-a2fb-325d538a77a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:02.761641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8f8bb-b274-441c-a2fb-325d538a77a3 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:02.761926 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8f8bb-b274-441c-a2fb-325d538a77a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:02.762201 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8f8bb-b274-441c-a2fb-325d538a77a3 None admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:02.762911 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8f8bb-b274-441c-a2fb-325d538a77a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:02.763214 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8f8bb-b274-441c-a2fb-325d538a77a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:02.764579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8f8bb-b274-441c-a2fb-325d538a77a3 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:02.775462 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 459/905] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Jul 12 18:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:02.781768 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87d18b-e3ad-4e5f-9024-f5afb67b6afa None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:02.877679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87d18b-e3ad-4e5f-9024-f5afb67b6afa None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:02.891880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:02.912503 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515efd0-4698-4c4e-9b3f-f8b763670562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:02.913299 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515efd0-4698-4c4e-9b3f-f8b763670562 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:02.913592 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515efd0-4698-4c4e-9b3f-f8b763670562 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:02.913884 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515efd0-4698-4c4e-9b3f-f8b763670562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:02.920406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515efd0-4698-4c4e-9b3f-f8b763670562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:02.921882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515efd0-4698-4c4e-9b3f-f8b763670562 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application [None req-e515efd0-4698-4c4e-9b3f-f8b763670562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:45:02.935319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application with Lock( Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:45:02.936365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:45:02.937496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:45:02.937496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:45:02.937496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:45:02.937496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:45:02.937496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:45:02.937496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:45:02.937496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:45:02.937496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: ERROR keystone.server.flask.application Jul 12 18:45:02.937496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 447/906] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Jul 12 18:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:45:02.942209 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8f8bb-b274-441c-a2fb-325d538a77a3 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:02.988429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:03.039312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8f8bb-b274-441c-a2fb-325d538a77a3 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:03.070454 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1dab10-4b44-47ca-a5d6-92c2abd9f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:03.071099 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dab10-4b44-47ca-a5d6-92c2abd9f663 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:03.071378 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dab10-4b44-47ca-a5d6-92c2abd9f663 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:03.071648 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1dab10-4b44-47ca-a5d6-92c2abd9f663 None admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:03.072408 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1dab10-4b44-47ca-a5d6-92c2abd9f663 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:03.072714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1dab10-4b44-47ca-a5d6-92c2abd9f663 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:03.074679 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1dab10-4b44-47ca-a5d6-92c2abd9f663 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:03.086040 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 460/907] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Jul 12 18:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:03.093716 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515efd0-4698-4c4e-9b3f-f8b763670562 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:03.190456 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515efd0-4698-4c4e-9b3f-f8b763670562 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:03.223036 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a439d1-4d8e-4708-ab5f-f4c30eaf56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:03.223685 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a439d1-4d8e-4708-ab5f-f4c30eaf56eb None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:03.223963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a439d1-4d8e-4708-ab5f-f4c30eaf56eb None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:03.224234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a439d1-4d8e-4708-ab5f-f4c30eaf56eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:03.225045 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a439d1-4d8e-4708-ab5f-f4c30eaf56eb None admin] RBAC: Adding query filter params (role.id=948b82ff28c547e78755c196cddfdd0e, scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00, user.id=ce92f306929849f98a89e3dadb26cb37) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:03.225382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a439d1-4d8e-4708-ab5f-f4c30eaf56eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:03.226802 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a439d1-4d8e-4708-ab5f-f4c30eaf56eb None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:03.233109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 448/908] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Jul 12 18:45:03 2022] GET /identity/v3/role_assignments?user.id=ce92f306929849f98a89e3dadb26cb37&scope.project.id=ae279b6ea9b04682832e4f2aaf4f9a00&role.id=948b82ff28c547e78755c196cddfdd0e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:05.459838 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905f7c-d4b4-4f9a-a047-e00802604f06 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:05.460373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905f7c-d4b4-4f9a-a047-e00802604f06 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:05.460373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74905f7c-d4b4-4f9a-a047-e00802604f06 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:05.461942 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 461/909] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:45:05.467439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d090-9374-407b-b766-b07a3483dbbe None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:05.467806 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d090-9374-407b-b766-b07a3483dbbe None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:05.467993 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43d090-9374-407b-b766-b07a3483dbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:05.484991 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-3a43d090-9374-407b-b766-b07a3483dbbe None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:45:05.486185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-3a43d090-9374-407b-b766-b07a3483dbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:45:05.513978 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:05.550124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 449/910] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:45:05 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:45:05.575256 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905f7c-d4b4-4f9a-a047-e00802604f06 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:05.687158 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74905f7c-d4b4-4f9a-a047-e00802604f06 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:05.694394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:05.721114 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8502e-7315-4505-b03c-d32efbc3f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:05.721867 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8502e-7315-4505-b03c-d32efbc3f8c7 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:05.722151 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8502e-7315-4505-b03c-d32efbc3f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:05.722428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8502e-7315-4505-b03c-d32efbc3f8c7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:05.723073 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8502e-7315-4505-b03c-d32efbc3f8c7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:05.724430 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8502e-7315-4505-b03c-d32efbc3f8c7 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-11a8502e-7315-4505-b03c-d32efbc3f8c7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:45:05.736691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:45:05.737901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:05.738794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 462/911] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Jul 12 18:45:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:45:05.743882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d090-9374-407b-b766-b07a3483dbbe None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:05.839599 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43d090-9374-407b-b766-b07a3483dbbe None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:05.871750 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96f967-018e-41a9-aa65-6a8c8c239461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:05.872403 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96f967-018e-41a9-aa65-6a8c8c239461 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:05.872687 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96f967-018e-41a9-aa65-6a8c8c239461 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:05.872962 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96f967-018e-41a9-aa65-6a8c8c239461 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:05.873702 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96f967-018e-41a9-aa65-6a8c8c239461 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:05.874009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96f967-018e-41a9-aa65-6a8c8c239461 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:05.875369 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96f967-018e-41a9-aa65-6a8c8c239461 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:05.880142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 450/912] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Jul 12 18:45:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:05.886286 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8502e-7315-4505-b03c-d32efbc3f8c7 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:05.982491 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8502e-7315-4505-b03c-d32efbc3f8c7 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:06.015071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508620b6-3cc1-4ce2-bee4-f82c4e5a4422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:06.015719 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508620b6-3cc1-4ce2-bee4-f82c4e5a4422 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:06.016001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508620b6-3cc1-4ce2-bee4-f82c4e5a4422 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:06.016277 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508620b6-3cc1-4ce2-bee4-f82c4e5a4422 None admin] PATH_INFO: `/v3/services` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:06.016966 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508620b6-3cc1-4ce2-bee4-f82c4e5a4422 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:06.017268 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508620b6-3cc1-4ce2-bee4-f82c4e5a4422 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:06.018651 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508620b6-3cc1-4ce2-bee4-f82c4e5a4422 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:06.022974 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 463/913] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Jul 12 18:45:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:08.246031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f82a1-4a9a-4185-8fc3-dcf9e18250c4 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:08.246528 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f82a1-4a9a-4185-8fc3-dcf9e18250c4 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:08.246642 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f82a1-4a9a-4185-8fc3-dcf9e18250c4 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:08.247959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 451/914] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:45:08.253006 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec506b-d064-4581-b7ee-2def467ec6cf None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:08.253422 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec506b-d064-4581-b7ee-2def467ec6cf None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:08.253590 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec506b-d064-4581-b7ee-2def467ec6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:08.269635 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-b4ec506b-d064-4581-b7ee-2def467ec6cf None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:45:08.270791 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-b4ec506b-d064-4581-b7ee-2def467ec6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:45:08.298370 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:08.337628 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 464/915] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:45:08 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:45:08.361749 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f82a1-4a9a-4185-8fc3-dcf9e18250c4 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:08.393532 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:08.462157 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f82a1-4a9a-4185-8fc3-dcf9e18250c4 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:08.494496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382d358-e1b7-45a5-b6d8-89c5453d3204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:08.495742 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d358-e1b7-45a5-b6d8-89c5453d3204 None admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:08.496029 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d358-e1b7-45a5-b6d8-89c5453d3204 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:08.496358 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d358-e1b7-45a5-b6d8-89c5453d3204 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:08.497022 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382d358-e1b7-45a5-b6d8-89c5453d3204 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:08.498418 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382d358-e1b7-45a5-b6d8-89c5453d3204 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:08.510913 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 452/916] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Jul 12 18:45:08 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:45:10.773459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a219d-86da-4e12-b920-f405feb2a657 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:10.774015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a219d-86da-4e12-b920-f405feb2a657 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:10.774015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a219d-86da-4e12-b920-f405feb2a657 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:10.775375 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 465/917] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:45:10.781333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e167d-40c6-4792-be42-d10469e7a8ee None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:10.781763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e167d-40c6-4792-be42-d10469e7a8ee None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:10.781893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e167d-40c6-4792-be42-d10469e7a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:10.798697 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-da0e167d-40c6-4792-be42-d10469e7a8ee None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:45:10.799880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-da0e167d-40c6-4792-be42-d10469e7a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:45:10.870127 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 453/918] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:45:10 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:45:10.894341 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a219d-86da-4e12-b920-f405feb2a657 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:10.992534 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a219d-86da-4e12-b920-f405feb2a657 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:11.025833 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df732c-3900-4979-821d-568b6c68b1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:11.026561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df732c-3900-4979-821d-568b6c68b1bd None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:11.026843 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df732c-3900-4979-821d-568b6c68b1bd None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:11.027116 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df732c-3900-4979-821d-568b6c68b1bd None admin] PATH_INFO: `/v3/services/placement` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:11.027767 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df732c-3900-4979-821d-568b6c68b1bd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:11.029131 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df732c-3900-4979-821d-568b6c68b1bd None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-c3df732c-3900-4979-821d-568b6c68b1bd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:45:11.041125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:45:11.042686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:11.043718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 466/919] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Jul 12 18:45:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:45:11.048790 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e167d-40c6-4792-be42-d10469e7a8ee None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:11.066945 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:11.147105 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e167d-40c6-4792-be42-d10469e7a8ee None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:11.180725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d5e3e-1a83-4f87-b453-c89d6ca49a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:11.181416 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5e3e-1a83-4f87-b453-c89d6ca49a52 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:11.181701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5e3e-1a83-4f87-b453-c89d6ca49a52 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:11.181975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d5e3e-1a83-4f87-b453-c89d6ca49a52 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:11.182698 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d5e3e-1a83-4f87-b453-c89d6ca49a52 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:11.183003 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d5e3e-1a83-4f87-b453-c89d6ca49a52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:11.184366 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d5e3e-1a83-4f87-b453-c89d6ca49a52 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:11.189307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 454/920] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Jul 12 18:45:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:11.195185 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df732c-3900-4979-821d-568b6c68b1bd None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:11.223387 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:11.293781 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df732c-3900-4979-821d-568b6c68b1bd None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:11.325673 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c767648-1be3-4fc6-88a4-230fc87f4bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:11.326312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767648-1be3-4fc6-88a4-230fc87f4bce None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:11.326595 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767648-1be3-4fc6-88a4-230fc87f4bce None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:11.326871 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767648-1be3-4fc6-88a4-230fc87f4bce None admin] PATH_INFO: `/v3/endpoints` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:11.327640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c767648-1be3-4fc6-88a4-230fc87f4bce None admin] RBAC: Adding query filter params (interface=public, service_id=0fd1e0df65bb42f4b0b8bb8fe6e79b2f, region_id=RegionOne) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:11.327949 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c767648-1be3-4fc6-88a4-230fc87f4bce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:11.329314 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c767648-1be3-4fc6-88a4-230fc87f4bce None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:11.334143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 467/921] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Jul 12 18:45:11 2022] GET /identity/v3/endpoints?service_id=0fd1e0df65bb42f4b0b8bb8fe6e79b2f&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:11.340394 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d5e3e-1a83-4f87-b453-c89d6ca49a52 None admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:11.419236 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:11.437034 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d5e3e-1a83-4f87-b453-c89d6ca49a52 None admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:11.470037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158c844-f016-4e4e-84e3-03d1b87863a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:11.470686 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158c844-f016-4e4e-84e3-03d1b87863a9 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:11.470970 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158c844-f016-4e4e-84e3-03d1b87863a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:11.471247 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158c844-f016-4e4e-84e3-03d1b87863a9 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:11.471916 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158c844-f016-4e4e-84e3-03d1b87863a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:11.473273 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158c844-f016-4e4e-84e3-03d1b87863a9 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:11.480214 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 455/922] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Jul 12 18:45:11 2022] GET /identity/v3/services => generated 1962 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:45:13.718154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482e4c-0c8b-4059-a188-5c3d631a1ac7 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:13.718703 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482e4c-0c8b-4059-a188-5c3d631a1ac7 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:13.718703 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482e4c-0c8b-4059-a188-5c3d631a1ac7 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:13.720069 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 468/923] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:45:13.725215 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de901d-9373-4d66-bf44-5bca9b8fa6c3 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:13.725608 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de901d-9373-4d66-bf44-5bca9b8fa6c3 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:13.725791 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de901d-9373-4d66-bf44-5bca9b8fa6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:13.742457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-90de901d-9373-4d66-bf44-5bca9b8fa6c3 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:45:13.743634 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-90de901d-9373-4d66-bf44-5bca9b8fa6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:45:13.808322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 456/924] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:45:13 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:45:13.832720 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8482e4c-0c8b-4059-a188-5c3d631a1ac7 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:13.922117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:13.931636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8482e4c-0c8b-4059-a188-5c3d631a1ac7 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:13.964742 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016aae46-a8a3-41db-b37c-859c5e028be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:13.965578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aae46-a8a3-41db-b37c-859c5e028be1 None admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:13.965862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aae46-a8a3-41db-b37c-859c5e028be1 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:13.966132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aae46-a8a3-41db-b37c-859c5e028be1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:13.966775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016aae46-a8a3-41db-b37c-859c5e028be1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:13.968117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016aae46-a8a3-41db-b37c-859c5e028be1 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application [None req-016aae46-a8a3-41db-b37c-859c5e028be1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:45:13.979939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:45:13.981054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application with Lock( Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: ERROR keystone.server.flask.application Jul 12 18:45:13.982008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 469/925] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Jul 12 18:45:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:45:13.987290 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de901d-9373-4d66-bf44-5bca9b8fa6c3 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:14.059771 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:14.082504 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de901d-9373-4d66-bf44-5bca9b8fa6c3 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:14.115034 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad8540-4014-4ca6-b774-5ee6092c7581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:14.115682 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad8540-4014-4ca6-b774-5ee6092c7581 None admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:14.115962 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad8540-4014-4ca6-b774-5ee6092c7581 None admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:14.116237 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad8540-4014-4ca6-b774-5ee6092c7581 None admin] PATH_INFO: `/v3/services` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:14.116933 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad8540-4014-4ca6-b774-5ee6092c7581 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:45:14.117240 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad8540-4014-4ca6-b774-5ee6092c7581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:14.118631 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad8540-4014-4ca6-b774-5ee6092c7581 None admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:14.124145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 457/926] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Jul 12 18:45:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:45:14.129951 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016aae46-a8a3-41db-b37c-859c5e028be1 None admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:45:14.225168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016aae46-a8a3-41db-b37c-859c5e028be1 None admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:45:14.256866 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e4b98-3186-4325-aef4-21c5324513a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:45:14.257459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e4b98-3186-4325-aef4-21c5324513a1 None admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:45:14.257739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e4b98-3186-4325-aef4-21c5324513a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:45:14.258012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e4b98-3186-4325-aef4-21c5324513a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:45:14.258736 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e4b98-3186-4325-aef4-21c5324513a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:45:14.260072 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e4b98-3186-4325-aef4-21c5324513a1 None admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:45:14.277878 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 470/927] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Jul 12 18:45:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:45:24.121320 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=30 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:24.273795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:46:12.663865 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19768e-d599-4998-b8aa-bc05efcdb118 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:12.664440 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19768e-d599-4998-b8aa-bc05efcdb118 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:12.664541 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19768e-d599-4998-b8aa-bc05efcdb118 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:12.666850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 458/928] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:12.672305 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52511-3c34-48f9-b5cf-d8965beaa080 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:12.673480 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52511-3c34-48f9-b5cf-d8965beaa080 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:12.674274 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52511-3c34-48f9-b5cf-d8965beaa080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:12.700154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-7fa52511-3c34-48f9-b5cf-d8965beaa080 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:12.703503 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-7fa52511-3c34-48f9-b5cf-d8965beaa080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:12.803585 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 471/929] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:12.858976 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d2c1c-6019-41c2-8fea-0baf998a936b None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:12.861200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d2c1c-6019-41c2-8fea-0baf998a936b None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:12.861200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110d2c1c-6019-41c2-8fea-0baf998a936b None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:12.861200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 459/930] 10.222.0.16 () {54 vars in 964 bytes} [Tue Jul 12 18:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:12.869674 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d7f5-cc73-41dd-b163-e4b2422c7dd2 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:12.870638 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d7f5-cc73-41dd-b163-e4b2422c7dd2 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:12.871050 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d7f5-cc73-41dd-b163-e4b2422c7dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:12.952462 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-f183d7f5-cc73-41dd-b163-e4b2422c7dd2 None None] MFA Rules not processed for user `b296e5ba36b243009b5fcfe708506c00`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:12.953702 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-f183d7f5-cc73-41dd-b163-e4b2422c7dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:13.017095 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 472/931] 10.222.0.16 () {58 vars in 1061 bytes} [Tue Jul 12 18:46:12 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:13.025789 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d2c1c-6019-41c2-8fea-0baf998a936b None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:13.037639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110d2c1c-6019-41c2-8fea-0baf998a936b None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:13.041145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3420f-dc9d-4101-8202-05300a17bdd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:13.041869 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3420f-dc9d-4101-8202-05300a17bdd6 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:13.042213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3420f-dc9d-4101-8202-05300a17bdd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:13.042402 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3420f-dc9d-4101-8202-05300a17bdd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:13.051370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3420f-dc9d-4101-8202-05300a17bdd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:13.052742 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3420f-dc9d-4101-8202-05300a17bdd6 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:13.062842 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 460/932] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:15.583153 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d11de4-1258-4c9f-a6f7-c906638ca138 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:15.583673 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d11de4-1258-4c9f-a6f7-c906638ca138 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:15.583759 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d11de4-1258-4c9f-a6f7-c906638ca138 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:15.585186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 473/933] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:15.590916 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60f011-ea60-4c32-ad25-6e66d6dcc96a None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:15.591346 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60f011-ea60-4c32-ad25-6e66d6dcc96a None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:15.591598 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60f011-ea60-4c32-ad25-6e66d6dcc96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:15.610183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-ca60f011-ea60-4c32-ad25-6e66d6dcc96a None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:15.611415 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-ca60f011-ea60-4c32-ad25-6e66d6dcc96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:15.619368 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 461/934] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:46:15.659521 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d11de4-1258-4c9f-a6f7-c906638ca138 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:15.669950 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d11de4-1258-4c9f-a6f7-c906638ca138 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:15.673271 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481111a-f551-4d07-bf15-d5ce518326a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:15.673925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481111a-f551-4d07-bf15-d5ce518326a1 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:15.674205 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481111a-f551-4d07-bf15-d5ce518326a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:15.674479 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481111a-f551-4d07-bf15-d5ce518326a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:15.683477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481111a-f551-4d07-bf15-d5ce518326a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:15.684885 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481111a-f551-4d07-bf15-d5ce518326a1 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:15.694251 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 474/935] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:18.271124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18c3d-b697-47bd-a117-2faa5622f021 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:18.271641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18c3d-b697-47bd-a117-2faa5622f021 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:18.271641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd18c3d-b697-47bd-a117-2faa5622f021 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:18.273164 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 462/936] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:18.278710 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f67b42-0f95-4dec-82d4-4f8693dba564 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:18.279121 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f67b42-0f95-4dec-82d4-4f8693dba564 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:18.279319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f67b42-0f95-4dec-82d4-4f8693dba564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:18.316125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-28f67b42-0f95-4dec-82d4-4f8693dba564 None None] MFA Rules not processed for user `0fbe2a791a454dbc9269f301d02d0d98`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:18.317339 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-28f67b42-0f95-4dec-82d4-4f8693dba564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:18.358634 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:46:18.387113 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 475/937] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:18 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:18.440512 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81caa-3020-4455-8669-54c5927dcbb0 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:18.440828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81caa-3020-4455-8669-54c5927dcbb0 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:18.441064 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f81caa-3020-4455-8669-54c5927dcbb0 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:18.442842 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 463/938] 10.222.0.16 () {54 vars in 964 bytes} [Tue Jul 12 18:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:18.449993 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5864-91bd-4c81-af58-2e952d42ba8c None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:18.450499 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5864-91bd-4c81-af58-2e952d42ba8c None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:18.450850 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a5864-91bd-4c81-af58-2e952d42ba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:18.469704 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-0b5a5864-91bd-4c81-af58-2e952d42ba8c None None] MFA Rules not processed for user `b296e5ba36b243009b5fcfe708506c00`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:18.471003 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-0b5a5864-91bd-4c81-af58-2e952d42ba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:18.477513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 476/939] 10.222.0.16 () {58 vars in 1061 bytes} [Tue Jul 12 18:46:18 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:18.486131 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f81caa-3020-4455-8669-54c5927dcbb0 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:18.496401 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f81caa-3020-4455-8669-54c5927dcbb0 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:18.499855 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cfecc-1db0-4ac4-893e-59b2fb49e323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:18.500479 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cfecc-1db0-4ac4-893e-59b2fb49e323 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:18.500763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cfecc-1db0-4ac4-893e-59b2fb49e323 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:18.501028 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cfecc-1db0-4ac4-893e-59b2fb49e323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:18.509675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cfecc-1db0-4ac4-893e-59b2fb49e323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:18.511632 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cfecc-1db0-4ac4-893e-59b2fb49e323 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:18.521025 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 464/940] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:18 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:21.739019 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264da037-4be1-421d-bdc1-cda924c37611 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:21.739534 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264da037-4be1-421d-bdc1-cda924c37611 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:21.739628 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264da037-4be1-421d-bdc1-cda924c37611 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:21.740935 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 477/941] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:46:21.746021 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87961f1d-a4c2-4ca3-bf4e-8474aca27889 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:21.746422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87961f1d-a4c2-4ca3-bf4e-8474aca27889 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:21.746584 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87961f1d-a4c2-4ca3-bf4e-8474aca27889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:21.764418 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-87961f1d-a4c2-4ca3-bf4e-8474aca27889 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:21.765638 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-87961f1d-a4c2-4ca3-bf4e-8474aca27889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:21.831978 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 465/942] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:21 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:21.871883 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264da037-4be1-421d-bdc1-cda924c37611 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:21.882337 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264da037-4be1-421d-bdc1-cda924c37611 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:21.885508 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b70b31-cd0f-4982-9b39-d8e6325a08a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:21.886140 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70b31-cd0f-4982-9b39-d8e6325a08a7 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:21.886419 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70b31-cd0f-4982-9b39-d8e6325a08a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:21.886691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b70b31-cd0f-4982-9b39-d8e6325a08a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:21.895198 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b70b31-cd0f-4982-9b39-d8e6325a08a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:21.896597 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b70b31-cd0f-4982-9b39-d8e6325a08a7 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:21.905646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 478/943] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:21 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:24.846626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bddf5-2572-4d3d-a3ee-424b31b38964 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:24.847181 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bddf5-2572-4d3d-a3ee-424b31b38964 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:24.847181 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bddf5-2572-4d3d-a3ee-424b31b38964 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:24.848554 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 466/944] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:24.853805 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37ea01-035a-42a9-a1ef-cba19bb81c71 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:24.854201 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37ea01-035a-42a9-a1ef-cba19bb81c71 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:24.854476 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37ea01-035a-42a9-a1ef-cba19bb81c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:24.874354 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-2a37ea01-035a-42a9-a1ef-cba19bb81c71 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:24.875527 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-2a37ea01-035a-42a9-a1ef-cba19bb81c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:24.883363 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 479/945] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:24.920466 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bddf5-2572-4d3d-a3ee-424b31b38964 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:24.934522 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bddf5-2572-4d3d-a3ee-424b31b38964 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:24.938131 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f7621-4128-494e-ad05-ad05fbf94b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:24.938775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7621-4128-494e-ad05-ad05fbf94b73 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:24.939059 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7621-4128-494e-ad05-ad05fbf94b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:24.939336 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f7621-4128-494e-ad05-ad05fbf94b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:24.948101 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f7621-4128-494e-ad05-ad05fbf94b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:24.950141 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f7621-4128-494e-ad05-ad05fbf94b73 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:24.959382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 467/946] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:27.226563 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29b8f5-6c37-4203-b1b0-dc5f696793a5 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:27.227120 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29b8f5-6c37-4203-b1b0-dc5f696793a5 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:27.227120 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29b8f5-6c37-4203-b1b0-dc5f696793a5 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:27.228433 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 480/947] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:27.234038 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993668ba-5f2e-4846-8fc6-538a5726d6db None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:27.234440 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993668ba-5f2e-4846-8fc6-538a5726d6db None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:27.234721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993668ba-5f2e-4846-8fc6-538a5726d6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:27.251910 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-993668ba-5f2e-4846-8fc6-538a5726d6db None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:27.253089 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-993668ba-5f2e-4846-8fc6-538a5726d6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:27.260762 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 468/948] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:27.298497 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29b8f5-6c37-4203-b1b0-dc5f696793a5 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:27.309093 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29b8f5-6c37-4203-b1b0-dc5f696793a5 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:27.312527 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578f761-4095-4ace-907f-1f3527bda004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:27.313162 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578f761-4095-4ace-907f-1f3527bda004 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:27.313475 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578f761-4095-4ace-907f-1f3527bda004 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:27.313776 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578f761-4095-4ace-907f-1f3527bda004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:27.322465 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578f761-4095-4ace-907f-1f3527bda004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:27.324382 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a578f761-4095-4ace-907f-1f3527bda004 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:27.333557 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 481/949] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:29.716458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ab44d-0369-44ca-83bc-119c524093c2 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:29.716951 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ab44d-0369-44ca-83bc-119c524093c2 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:29.716951 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ab44d-0369-44ca-83bc-119c524093c2 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:29.718421 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 469/950] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:29.723747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352f8c7-11bb-49ed-8a72-ec81945ab10b None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:29.724143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352f8c7-11bb-49ed-8a72-ec81945ab10b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:29.724423 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352f8c7-11bb-49ed-8a72-ec81945ab10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:29.741625 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-2352f8c7-11bb-49ed-8a72-ec81945ab10b None None] MFA Rules not processed for user `0fbe2a791a454dbc9269f301d02d0d98`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:29.742810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-2352f8c7-11bb-49ed-8a72-ec81945ab10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:29.750645 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 482/951] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:29 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:29.789623 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ab44d-0369-44ca-83bc-119c524093c2 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:29.800013 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ab44d-0369-44ca-83bc-119c524093c2 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:29.803458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e0ede-c8dc-49d0-bbef-66cd617d0003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:29.804092 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e0ede-c8dc-49d0-bbef-66cd617d0003 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:29.804375 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e0ede-c8dc-49d0-bbef-66cd617d0003 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:29.804648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e0ede-c8dc-49d0-bbef-66cd617d0003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:29.813316 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e0ede-c8dc-49d0-bbef-66cd617d0003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:29.814741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e0ede-c8dc-49d0-bbef-66cd617d0003 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:29.824529 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 470/952] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:29 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:32.306936 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb0ca-1247-436e-abdd-8f20f6832d33 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:32.307515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb0ca-1247-436e-abdd-8f20f6832d33 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:32.307515 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efb0ca-1247-436e-abdd-8f20f6832d33 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:32.309486 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 483/953] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:32.315147 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad9d20-71d2-4b1a-b52b-204570c0bbe3 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:32.315638 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad9d20-71d2-4b1a-b52b-204570c0bbe3 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:32.315749 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad9d20-71d2-4b1a-b52b-204570c0bbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:32.334559 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-4cad9d20-71d2-4b1a-b52b-204570c0bbe3 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:32.335805 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-4cad9d20-71d2-4b1a-b52b-204570c0bbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:32.343594 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 471/954] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:32.381230 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efb0ca-1247-436e-abdd-8f20f6832d33 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:32.392565 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efb0ca-1247-436e-abdd-8f20f6832d33 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:32.396163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bea693-c97c-4c0d-b6f9-271f023ad150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:32.396827 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bea693-c97c-4c0d-b6f9-271f023ad150 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:32.397108 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bea693-c97c-4c0d-b6f9-271f023ad150 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:32.397426 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bea693-c97c-4c0d-b6f9-271f023ad150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:32.407454 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bea693-c97c-4c0d-b6f9-271f023ad150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:32.409192 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bea693-c97c-4c0d-b6f9-271f023ad150 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:32.419788 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 484/955] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:34.705553 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e668964-90f1-4d21-84e1-e2ae1bf1aeff None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:34.706045 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e668964-90f1-4d21-84e1-e2ae1bf1aeff None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:34.706045 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e668964-90f1-4d21-84e1-e2ae1bf1aeff None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:34.707389 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 472/956] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:34.712593 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026999-e760-4aec-ae17-c797c0792b4d None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:34.713000 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026999-e760-4aec-ae17-c797c0792b4d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:34.713272 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7026999-e760-4aec-ae17-c797c0792b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:34.732057 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-c7026999-e760-4aec-ae17-c797c0792b4d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:34.733253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-c7026999-e760-4aec-ae17-c797c0792b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:34.740919 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 485/957] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:34.781609 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e668964-90f1-4d21-84e1-e2ae1bf1aeff None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:34.787228 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=65 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:46:34.794014 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e668964-90f1-4d21-84e1-e2ae1bf1aeff None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:34.797415 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9190f7-20e6-485d-a3c9-fea003699e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:34.798050 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9190f7-20e6-485d-a3c9-fea003699e54 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:34.798362 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9190f7-20e6-485d-a3c9-fea003699e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:34.798642 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9190f7-20e6-485d-a3c9-fea003699e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:34.807314 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9190f7-20e6-485d-a3c9-fea003699e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:34.808737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9190f7-20e6-485d-a3c9-fea003699e54 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:34.818215 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 473/958] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:37.363301 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a989d-1022-42d1-b3ae-a2ae8ebc95d0 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:37.363875 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a989d-1022-42d1-b3ae-a2ae8ebc95d0 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:37.363875 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a989d-1022-42d1-b3ae-a2ae8ebc95d0 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:37.365225 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 486/959] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:37.370279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac676f-134e-42a5-bc93-9473dd1be35a None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:37.370667 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac676f-134e-42a5-bc93-9473dd1be35a None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:37.370866 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac676f-134e-42a5-bc93-9473dd1be35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:37.388771 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-74ac676f-134e-42a5-bc93-9473dd1be35a None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:37.389979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-74ac676f-134e-42a5-bc93-9473dd1be35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:37.397498 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 474/960] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:37 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:37.434708 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a989d-1022-42d1-b3ae-a2ae8ebc95d0 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:37.445121 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a989d-1022-42d1-b3ae-a2ae8ebc95d0 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:37.449125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825ae8b-0c42-4c71-b349-4f4c4e388c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:37.449809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825ae8b-0c42-4c71-b349-4f4c4e388c29 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:37.450097 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825ae8b-0c42-4c71-b349-4f4c4e388c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:37.450390 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825ae8b-0c42-4c71-b349-4f4c4e388c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:37.459003 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825ae8b-0c42-4c71-b349-4f4c4e388c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:37.460420 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825ae8b-0c42-4c71-b349-4f4c4e388c29 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:37.472237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 487/961] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:37 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:41.689019 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57610c-f765-4291-b13d-66fd52dbb1ea None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:41.689574 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57610c-f765-4291-b13d-66fd52dbb1ea None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:41.689574 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57610c-f765-4291-b13d-66fd52dbb1ea None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:41.690892 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 475/962] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:41.696041 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f409b2c-2772-4bfb-b8b4-7fda62baaaa0 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:41.696455 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f409b2c-2772-4bfb-b8b4-7fda62baaaa0 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:41.696725 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f409b2c-2772-4bfb-b8b4-7fda62baaaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:41.715122 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-1f409b2c-2772-4bfb-b8b4-7fda62baaaa0 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:41.716298 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-1f409b2c-2772-4bfb-b8b4-7fda62baaaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:41.725908 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 488/963] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:41.765379 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57610c-f765-4291-b13d-66fd52dbb1ea None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:41.775826 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57610c-f765-4291-b13d-66fd52dbb1ea None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:41.779783 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c711e-c3d8-43b6-85fc-c8afd0312896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:41.780407 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c711e-c3d8-43b6-85fc-c8afd0312896 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:41.780685 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c711e-c3d8-43b6-85fc-c8afd0312896 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:41.780955 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c711e-c3d8-43b6-85fc-c8afd0312896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:41.789942 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c711e-c3d8-43b6-85fc-c8afd0312896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:41.791379 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c711e-c3d8-43b6-85fc-c8afd0312896 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:41.800985 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 476/964] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:44.669314 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013317d0-d03a-49f1-9de5-99237668b8c1 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:44.669826 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013317d0-d03a-49f1-9de5-99237668b8c1 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:44.669903 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013317d0-d03a-49f1-9de5-99237668b8c1 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:44.671266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 489/965] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:44.676722 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d38f6-c1e2-4759-a269-d9292793dd6d None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:44.677276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d38f6-c1e2-4759-a269-d9292793dd6d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:44.677276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d38f6-c1e2-4759-a269-d9292793dd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:44.696716 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-d75d38f6-c1e2-4759-a269-d9292793dd6d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:44.697943 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-d75d38f6-c1e2-4759-a269-d9292793dd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:44.707096 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 477/966] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:44 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:44.746246 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013317d0-d03a-49f1-9de5-99237668b8c1 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:44.756590 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013317d0-d03a-49f1-9de5-99237668b8c1 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:44.760013 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2befe84-ba71-4a68-8c04-15f033aa6785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:44.760770 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befe84-ba71-4a68-8c04-15f033aa6785 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:44.761054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befe84-ba71-4a68-8c04-15f033aa6785 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:44.761900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2befe84-ba71-4a68-8c04-15f033aa6785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:44.770501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2befe84-ba71-4a68-8c04-15f033aa6785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:44.771914 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2befe84-ba71-4a68-8c04-15f033aa6785 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:44.782482 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 490/967] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:44 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:49.012794 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b9a1-94ad-4603-8865-538514bfe734 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:49.013348 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b9a1-94ad-4603-8865-538514bfe734 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:49.013459 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b9a1-94ad-4603-8865-538514bfe734 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:49.014826 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 478/968] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:49.020020 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe58546-3db9-4b6e-8cd3-108a2176a76b None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:49.020436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe58546-3db9-4b6e-8cd3-108a2176a76b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:49.020566 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe58546-3db9-4b6e-8cd3-108a2176a76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:49.026594 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=57 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:46:49.039460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-abe58546-3db9-4b6e-8cd3-108a2176a76b None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:49.040645 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-abe58546-3db9-4b6e-8cd3-108a2176a76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:49.048994 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 491/969] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:46:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:49.087386 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b9a1-94ad-4603-8865-538514bfe734 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:46:49.098477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b9a1-94ad-4603-8865-538514bfe734 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:46:49.101946 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98086b37-cbe5-436e-9381-829d12f87f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:46:49.102610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98086b37-cbe5-436e-9381-829d12f87f3b service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:49.102895 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98086b37-cbe5-436e-9381-829d12f87f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:49.103172 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98086b37-cbe5-436e-9381-829d12f87f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:49.113550 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98086b37-cbe5-436e-9381-829d12f87f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:46:49.115107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98086b37-cbe5-436e-9381-829d12f87f3b service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:46:49.124618 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 479/970] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:46:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:46:54.670573 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a71895-387f-4409-9f3f-997063c9793f None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:54.671525 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a71895-387f-4409-9f3f-997063c9793f None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:54.672003 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a71895-387f-4409-9f3f-997063c9793f None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:54.674064 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 492/971] 10.222.0.16 () {54 vars in 921 bytes} [Tue Jul 12 18:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:54.679810 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63349c5f-6487-4c48-97d0-d82d9e7ccc78 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:54.680227 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63349c5f-6487-4c48-97d0-d82d9e7ccc78 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:54.680365 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63349c5f-6487-4c48-97d0-d82d9e7ccc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:54.720532 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-63349c5f-6487-4c48-97d0-d82d9e7ccc78 None None] MFA Rules not processed for user `ce92f306929849f98a89e3dadb26cb37`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:54.722055 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-63349c5f-6487-4c48-97d0-d82d9e7ccc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:54.802831 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 480/972] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Jul 12 18:46:54 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:46:59.035085 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=2 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:46:59.087336 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf818a0-9c8c-4593-aca8-9da9b1c5e737 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:59.087651 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf818a0-9c8c-4593-aca8-9da9b1c5e737 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:59.087926 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf818a0-9c8c-4593-aca8-9da9b1c5e737 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:59.090142 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 493/973] 10.222.0.16 () {54 vars in 921 bytes} [Tue Jul 12 18:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:46:59.096145 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea71d4-5e66-48b5-8fa0-f7e16807c657 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:46:59.096642 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea71d4-5e66-48b5-8fa0-f7e16807c657 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:46:59.096721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea71d4-5e66-48b5-8fa0-f7e16807c657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:46:59.115380 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-69ea71d4-5e66-48b5-8fa0-f7e16807c657 None None] MFA Rules not processed for user `ce92f306929849f98a89e3dadb26cb37`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:46:59.116561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-69ea71d4-5e66-48b5-8fa0-f7e16807c657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:46:59.124930 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 481/974] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Jul 12 18:46:59 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:00.725965 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684bc4b-5f17-4179-9caf-6166c692fbcf None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:00.726968 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684bc4b-5f17-4179-9caf-6166c692fbcf None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:00.727264 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684bc4b-5f17-4179-9caf-6166c692fbcf None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:00.728901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 494/975] 10.222.0.16 () {54 vars in 921 bytes} [Tue Jul 12 18:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:00.734481 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c307-2dc0-4225-97e0-efabc6589311 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:00.734897 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c307-2dc0-4225-97e0-efabc6589311 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:00.735095 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c307-2dc0-4225-97e0-efabc6589311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:00.753577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-c266c307-2dc0-4225-97e0-efabc6589311 None None] MFA Rules not processed for user `ce92f306929849f98a89e3dadb26cb37`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:00.754768 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-c266c307-2dc0-4225-97e0-efabc6589311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:00.763778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 482/976] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Jul 12 18:47:00 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:47:04.722121 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5fb1-a90c-4ffa-9733-8e32bb3c6598 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:04.722641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5fb1-a90c-4ffa-9733-8e32bb3c6598 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:04.722641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b5fb1-a90c-4ffa-9733-8e32bb3c6598 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:04.724081 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 495/977] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:04.729138 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5de7d-5adf-4d37-b218-9558db53dbd5 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:04.730013 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5de7d-5adf-4d37-b218-9558db53dbd5 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:04.731119 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5de7d-5adf-4d37-b218-9558db53dbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:04.750853 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-54d5de7d-5adf-4d37-b218-9558db53dbd5 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:04.752390 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-54d5de7d-5adf-4d37-b218-9558db53dbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:04.773317 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 483/978] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:04.822810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca999a9-c98e-4f1d-821c-96d4de0e617b None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:04.824615 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca999a9-c98e-4f1d-821c-96d4de0e617b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:04.825249 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca999a9-c98e-4f1d-821c-96d4de0e617b None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:04.829561 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 496/979] 10.222.0.16 () {54 vars in 961 bytes} [Tue Jul 12 18:47:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:04.839372 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf48bbb-8fa8-4994-9d4a-da185793683e None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:04.840561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf48bbb-8fa8-4994-9d4a-da185793683e None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:04.841073 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf48bbb-8fa8-4994-9d4a-da185793683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:04.849591 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=72 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:04.887450 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-4bf48bbb-8fa8-4994-9d4a-da185793683e None None] MFA Rules not processed for user `72918f9adc4240d99640b419e013b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:04.889700 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-4bf48bbb-8fa8-4994-9d4a-da185793683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:04.963901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 484/980] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Jul 12 18:47:04 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:04.971237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca999a9-c98e-4f1d-821c-96d4de0e617b None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:04.984726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca999a9-c98e-4f1d-821c-96d4de0e617b None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:04.989602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb1da3-6abe-4d24-ae3c-8145ed657f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:04.990240 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb1da3-6abe-4d24-ae3c-8145ed657f67 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:04.990643 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb1da3-6abe-4d24-ae3c-8145ed657f67 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:04.990932 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb1da3-6abe-4d24-ae3c-8145ed657f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:04.999294 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb1da3-6abe-4d24-ae3c-8145ed657f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:05.001201 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb1da3-6abe-4d24-ae3c-8145ed657f67 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:05.011162 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 497/981] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:47:07.481345 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05657e71-a084-45fb-86f0-9e8650039f9c None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:07.481856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05657e71-a084-45fb-86f0-9e8650039f9c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:07.481958 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05657e71-a084-45fb-86f0-9e8650039f9c None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:07.483399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 485/982] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:07.488375 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac6806-b92d-4250-8daa-3f8522c5112e None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:07.488789 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac6806-b92d-4250-8daa-3f8522c5112e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:07.488957 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac6806-b92d-4250-8daa-3f8522c5112e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:07.510094 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-1aac6806-b92d-4250-8daa-3f8522c5112e None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:07.511276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-1aac6806-b92d-4250-8daa-3f8522c5112e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:07.520060 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 498/983] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:07.565827 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05657e71-a084-45fb-86f0-9e8650039f9c None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:07.580330 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05657e71-a084-45fb-86f0-9e8650039f9c None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:07.585252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e284636-23bd-4cd5-ad89-3db3d204ccfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:07.586051 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284636-23bd-4cd5-ad89-3db3d204ccfb service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:07.586429 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284636-23bd-4cd5-ad89-3db3d204ccfb service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:07.586781 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e284636-23bd-4cd5-ad89-3db3d204ccfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:07.595375 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e284636-23bd-4cd5-ad89-3db3d204ccfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:07.597127 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e284636-23bd-4cd5-ad89-3db3d204ccfb service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:07.607158 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 486/984] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:10.184684 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29ce77-9941-4300-b1ee-e10f5cde6d7d None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:10.185154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29ce77-9941-4300-b1ee-e10f5cde6d7d None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:10.185154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29ce77-9941-4300-b1ee-e10f5cde6d7d None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:10.186781 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 499/985] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:10.193220 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410e6bf-23ec-47c8-9986-3b6f4ccdcaec None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:10.194215 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410e6bf-23ec-47c8-9986-3b6f4ccdcaec None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:10.194700 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410e6bf-23ec-47c8-9986-3b6f4ccdcaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:10.214732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-2410e6bf-23ec-47c8-9986-3b6f4ccdcaec None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:10.216767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-2410e6bf-23ec-47c8-9986-3b6f4ccdcaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:10.229675 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 487/986] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:10.272430 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43694c-2bab-4dc2-8e4a-66bc8e289901 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:10.272717 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43694c-2bab-4dc2-8e4a-66bc8e289901 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:10.272996 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43694c-2bab-4dc2-8e4a-66bc8e289901 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:10.274400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 500/987] 10.222.0.16 () {54 vars in 961 bytes} [Tue Jul 12 18:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:10.280496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1d489-f923-4100-a452-68151c7289c8 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:10.280791 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1d489-f923-4100-a452-68151c7289c8 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:10.281078 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1d489-f923-4100-a452-68151c7289c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:10.299158 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-8fb1d489-f923-4100-a452-68151c7289c8 None None] MFA Rules not processed for user `72918f9adc4240d99640b419e013b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:10.300337 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-8fb1d489-f923-4100-a452-68151c7289c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:10.308783 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 488/988] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Jul 12 18:47:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:10.316281 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43694c-2bab-4dc2-8e4a-66bc8e289901 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:10.329781 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43694c-2bab-4dc2-8e4a-66bc8e289901 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:10.334596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa96e1c-49a2-4420-8212-7665e768923a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:10.335222 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa96e1c-49a2-4420-8212-7665e768923a service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:10.335501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa96e1c-49a2-4420-8212-7665e768923a service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:10.335775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa96e1c-49a2-4420-8212-7665e768923a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:10.344266 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa96e1c-49a2-4420-8212-7665e768923a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:10.345856 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa96e1c-49a2-4420-8212-7665e768923a service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:10.355416 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 501/989] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:12.732733 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8b480-f5ea-494e-8df0-c255cc1a35d7 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:12.733315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8b480-f5ea-494e-8df0-c255cc1a35d7 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:12.733315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8b480-f5ea-494e-8df0-c255cc1a35d7 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:12.738628 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 489/990] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:12.739993 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bc58d-64f7-4681-a044-abc3ab21457b None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:12.740483 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bc58d-64f7-4681-a044-abc3ab21457b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:12.740580 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bc58d-64f7-4681-a044-abc3ab21457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:12.759523 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-3c1bc58d-64f7-4681-a044-abc3ab21457b None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:12.760987 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-3c1bc58d-64f7-4681-a044-abc3ab21457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:12.769690 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 502/991] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:47:12.817515 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8b480-f5ea-494e-8df0-c255cc1a35d7 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:12.832437 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8b480-f5ea-494e-8df0-c255cc1a35d7 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:12.837901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae25f4b-e9e2-47b3-b509-b80811fa06c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:12.838834 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25f4b-e9e2-47b3-b509-b80811fa06c4 service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:12.839308 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25f4b-e9e2-47b3-b509-b80811fa06c4 service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:12.840284 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25f4b-e9e2-47b3-b509-b80811fa06c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:12.851406 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae25f4b-e9e2-47b3-b509-b80811fa06c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:12.853185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae25f4b-e9e2-47b3-b509-b80811fa06c4 service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:12.879532 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 490/992] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:14.684872 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3befecb-3d9b-480b-b0cd-f913f1e2a254 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:14.685399 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3befecb-3d9b-480b-b0cd-f913f1e2a254 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:14.685493 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3befecb-3d9b-480b-b0cd-f913f1e2a254 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:14.696373 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 503/993] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:14 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:14.704749 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5b9d4-b2c7-453c-a9b4-1c3098b021ea None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:14.705230 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5b9d4-b2c7-453c-a9b4-1c3098b021ea None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:14.705345 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5b9d4-b2c7-453c-a9b4-1c3098b021ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:14.743465 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-25a5b9d4-b2c7-453c-a9b4-1c3098b021ea None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:14.744857 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-25a5b9d4-b2c7-453c-a9b4-1c3098b021ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:14.754222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 491/994] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:15.065558 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f2ce-6bd3-4c81-aefb-95bcdd53372e None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:15.066189 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f2ce-6bd3-4c81-aefb-95bcdd53372e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:15.066189 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6f2ce-6bd3-4c81-aefb-95bcdd53372e None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:15.067630 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 504/995] 10.222.0.16 () {54 vars in 963 bytes} [Tue Jul 12 18:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:15.072460 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab02cdd-9917-49a4-ab3a-e718592ac488 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:15.072755 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab02cdd-9917-49a4-ab3a-e718592ac488 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:15.073040 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab02cdd-9917-49a4-ab3a-e718592ac488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:15.111604 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-0ab02cdd-9917-49a4-ab3a-e718592ac488 None None] MFA Rules not processed for user `a60cee165d0f46ef8078a91f03788410`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:15.112846 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-0ab02cdd-9917-49a4-ab3a-e718592ac488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:15.179746 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 492/996] 10.222.0.16 () {58 vars in 1060 bytes} [Tue Jul 12 18:47:15 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:15.187655 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f2ce-6bd3-4c81-aefb-95bcdd53372e None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:15.198572 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6f2ce-6bd3-4c81-aefb-95bcdd53372e None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:15.202732 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4156a79-4281-4013-831d-32e471bb4d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a60cee165d0f46ef8078a91f03788410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:15.203622 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4156a79-4281-4013-831d-32e471bb4d24 service cinder] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:15.203907 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4156a79-4281-4013-831d-32e471bb4d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:15.204181 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4156a79-4281-4013-831d-32e471bb4d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:15.214654 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4156a79-4281-4013-831d-32e471bb4d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:15.216125 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4156a79-4281-4013-831d-32e471bb4d24 service cinder] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:15.227115 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 505/997] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:15.281986 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023725d6-4360-444d-b2c7-bcdf232d17d7 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:15.282274 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023725d6-4360-444d-b2c7-bcdf232d17d7 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:15.282550 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023725d6-4360-444d-b2c7-bcdf232d17d7 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:15.284085 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 493/998] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:15.289428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca3dba-efb4-407f-8754-2b10a312ee30 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:15.289718 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca3dba-efb4-407f-8754-2b10a312ee30 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:15.289996 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca3dba-efb4-407f-8754-2b10a312ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:15.307825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-1bca3dba-efb4-407f-8754-2b10a312ee30 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:15.309511 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-1bca3dba-efb4-407f-8754-2b10a312ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:15.317327 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 506/999] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:15.362321 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023725d6-4360-444d-b2c7-bcdf232d17d7 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:15.376189 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023725d6-4360-444d-b2c7-bcdf232d17d7 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:15.382292 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe2e9a-4126-4579-bab4-c6fea91ee820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:15.382922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe2e9a-4126-4579-bab4-c6fea91ee820 service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:15.383202 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe2e9a-4126-4579-bab4-c6fea91ee820 service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:15.383478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe2e9a-4126-4579-bab4-c6fea91ee820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:15.392104 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe2e9a-4126-4579-bab4-c6fea91ee820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:15.393828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe2e9a-4126-4579-bab4-c6fea91ee820 service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:15.403119 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 494/1000] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:17.731250 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e539e2-d455-4db6-830f-a3b542d51a13 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:17.731701 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e539e2-d455-4db6-830f-a3b542d51a13 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:17.731896 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e539e2-d455-4db6-830f-a3b542d51a13 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:17.733234 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 507/1001] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:17.738607 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b32f-9787-4cf2-bbab-b430c67e3294 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:17.739029 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b32f-9787-4cf2-bbab-b430c67e3294 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:17.739168 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0b32f-9787-4cf2-bbab-b430c67e3294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:17.746589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:17.758728 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-d9b0b32f-9787-4cf2-bbab-b430c67e3294 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:17.759933 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-d9b0b32f-9787-4cf2-bbab-b430c67e3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:17.768931 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 495/1002] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:17.815755 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e539e2-d455-4db6-830f-a3b542d51a13 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:17.829804 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e539e2-d455-4db6-830f-a3b542d51a13 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:17.835758 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e6771f-6198-4450-9168-f7d9a4ca1faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:17.836405 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6771f-6198-4450-9168-f7d9a4ca1faf service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:17.836765 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6771f-6198-4450-9168-f7d9a4ca1faf service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:17.837036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e6771f-6198-4450-9168-f7d9a4ca1faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:17.846137 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6771f-6198-4450-9168-f7d9a4ca1faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:17.847806 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e6771f-6198-4450-9168-f7d9a4ca1faf service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:17.858161 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 508/1003] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:20.169861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b036747-5be3-42b4-8b09-6b44b15952de None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:20.170393 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b036747-5be3-42b4-8b09-6b44b15952de None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:20.170393 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b036747-5be3-42b4-8b09-6b44b15952de None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:20.171688 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 496/1004] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:20.176799 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e10a2-a278-47da-921e-c9d2ec961729 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:20.177190 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e10a2-a278-47da-921e-c9d2ec961729 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:20.177380 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e10a2-a278-47da-921e-c9d2ec961729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:20.194929 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-3f2e10a2-a278-47da-921e-c9d2ec961729 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:20.196105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-3f2e10a2-a278-47da-921e-c9d2ec961729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:20.203823 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 509/1005] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:20.247233 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b036747-5be3-42b4-8b09-6b44b15952de None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:20.260964 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b036747-5be3-42b4-8b09-6b44b15952de None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:20.267417 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262e447-4483-49d3-a1b5-5b0fa2f7df4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:20.268061 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e447-4483-49d3-a1b5-5b0fa2f7df4a service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:20.268346 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e447-4483-49d3-a1b5-5b0fa2f7df4a service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:20.268625 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e447-4483-49d3-a1b5-5b0fa2f7df4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:20.277983 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262e447-4483-49d3-a1b5-5b0fa2f7df4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:20.279552 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262e447-4483-49d3-a1b5-5b0fa2f7df4a service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:20.289650 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 497/1006] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:22.546342 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05e2ba-e131-4595-a028-bdd310bc7873 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:22.546884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05e2ba-e131-4595-a028-bdd310bc7873 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:22.546884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05e2ba-e131-4595-a028-bdd310bc7873 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:22.548238 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 510/1007] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:22.553294 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747d997-d7b1-42ed-b56b-14db1c20c49c None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:22.553704 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747d997-d7b1-42ed-b56b-14db1c20c49c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:22.553849 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747d997-d7b1-42ed-b56b-14db1c20c49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:22.571919 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-5747d997-d7b1-42ed-b56b-14db1c20c49c None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:22.573324 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-5747d997-d7b1-42ed-b56b-14db1c20c49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:22.581102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 498/1008] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:22.627547 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05e2ba-e131-4595-a028-bdd310bc7873 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:22.641944 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05e2ba-e131-4595-a028-bdd310bc7873 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:22.648236 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef225e-c662-4623-a7c3-e48d6071edf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:22.648986 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef225e-c662-4623-a7c3-e48d6071edf7 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:22.649395 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef225e-c662-4623-a7c3-e48d6071edf7 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:22.649874 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef225e-c662-4623-a7c3-e48d6071edf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:22.659411 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef225e-c662-4623-a7c3-e48d6071edf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:22.661492 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef225e-c662-4623-a7c3-e48d6071edf7 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:22.671714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 511/1009] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:25.337092 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326cd67-1a21-4ebf-a9ad-8c5c125ce659 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:25.337680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326cd67-1a21-4ebf-a9ad-8c5c125ce659 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:25.337680 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326cd67-1a21-4ebf-a9ad-8c5c125ce659 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:25.339041 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 499/1010] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:25.344436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09089b9-b9c8-4c09-81f5-637a3640707b None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:25.344889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09089b9-b9c8-4c09-81f5-637a3640707b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:25.344978 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09089b9-b9c8-4c09-81f5-637a3640707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:25.363168 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-e09089b9-b9c8-4c09-81f5-637a3640707b None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:25.364347 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-e09089b9-b9c8-4c09-81f5-637a3640707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:25.373369 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 512/1011] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:25.422267 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326cd67-1a21-4ebf-a9ad-8c5c125ce659 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:25.439085 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326cd67-1a21-4ebf-a9ad-8c5c125ce659 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:25.444931 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e8215-f1f4-4149-8617-743be7e4cc23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:25.445766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8215-f1f4-4149-8617-743be7e4cc23 service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:25.446100 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8215-f1f4-4149-8617-743be7e4cc23 service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:25.446440 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e8215-f1f4-4149-8617-743be7e4cc23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:25.457204 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e8215-f1f4-4149-8617-743be7e4cc23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:25.460546 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e8215-f1f4-4149-8617-743be7e4cc23 service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:25.472271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 500/1012] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:47:28.468618 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b746eb-f241-4a90-aef1-05fadb397637 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:28.469350 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b746eb-f241-4a90-aef1-05fadb397637 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:28.469350 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b746eb-f241-4a90-aef1-05fadb397637 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:28.470728 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 513/1013] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:28.476158 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae48282-063f-4b6f-92b2-a786539410f5 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:28.476624 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae48282-063f-4b6f-92b2-a786539410f5 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:28.476718 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae48282-063f-4b6f-92b2-a786539410f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:28.499803 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-fae48282-063f-4b6f-92b2-a786539410f5 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:28.500988 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-fae48282-063f-4b6f-92b2-a786539410f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:28.508606 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 501/1014] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:28.557359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b746eb-f241-4a90-aef1-05fadb397637 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:28.570533 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b746eb-f241-4a90-aef1-05fadb397637 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:28.578304 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214848b-98c9-419a-a736-6574987bfbd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:28.579173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214848b-98c9-419a-a736-6574987bfbd3 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:28.579537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214848b-98c9-419a-a736-6574987bfbd3 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:28.579900 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214848b-98c9-419a-a736-6574987bfbd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:28.591299 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214848b-98c9-419a-a736-6574987bfbd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:28.593412 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214848b-98c9-419a-a736-6574987bfbd3 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:28.606170 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 514/1015] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:31.363101 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b084-ed87-4b0a-bf12-059abeb411ef None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:31.363791 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b084-ed87-4b0a-bf12-059abeb411ef None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:31.363791 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713b084-ed87-4b0a-bf12-059abeb411ef None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:31.365146 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 502/1016] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:31.370050 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f745f8e-51de-4219-894d-bd65bfd26681 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:31.370214 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1be8-f13c-4f33-9eb8-ba8791a6c709 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:31.370658 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f745f8e-51de-4219-894d-bd65bfd26681 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:31.370776 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1be8-f13c-4f33-9eb8-ba8791a6c709 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:31.370877 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f745f8e-51de-4219-894d-bd65bfd26681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:31.370980 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1be8-f13c-4f33-9eb8-ba8791a6c709 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:31.372481 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 515/1017] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:31.377334 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e624991-9604-48f5-9a91-379b1d02368c None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:31.377633 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e624991-9604-48f5-9a91-379b1d02368c None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:31.377916 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e624991-9604-48f5-9a91-379b1d02368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:31.383858 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=52 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:31.390051 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-2f745f8e-51de-4219-894d-bd65bfd26681 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:31.391255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-2f745f8e-51de-4219-894d-bd65bfd26681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:31.396606 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-1e624991-9604-48f5-9a91-379b1d02368c None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:31.397789 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-1e624991-9604-48f5-9a91-379b1d02368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:31.399035 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 503/1018] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:47:31.405495 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 516/1019] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:47:31.451152 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f745f8e-51de-4219-894d-bd65bfd26681 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:31.455668 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fede17-6288-444a-9876-86add5b74095 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:31.455957 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fede17-6288-444a-9876-86add5b74095 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:31.456238 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fede17-6288-444a-9876-86add5b74095 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:31.457629 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 517/1020] 10.222.0.16 () {54 vars in 962 bytes} [Tue Jul 12 18:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:47:31.462490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f745f8e-51de-4219-894d-bd65bfd26681 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:31.462623 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1fe17-29f0-47c2-a11d-2d531e11eb2a None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:31.462797 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1fe17-29f0-47c2-a11d-2d531e11eb2a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:31.463078 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1fe17-29f0-47c2-a11d-2d531e11eb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:31.467440 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d2907-0ef8-4822-8ab7-ffac9365fb73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:31.468076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2907-0ef8-4822-8ab7-ffac9365fb73 service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:31.468366 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2907-0ef8-4822-8ab7-ffac9365fb73 service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:31.468647 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2907-0ef8-4822-8ab7-ffac9365fb73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:31.477339 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d2907-0ef8-4822-8ab7-ffac9365fb73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:31.478928 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d2907-0ef8-4822-8ab7-ffac9365fb73 service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:31.488366 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 504/1021] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:31.500599 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-97a1fe17-29f0-47c2-a11d-2d531e11eb2a None None] MFA Rules not processed for user `86c0b548be2d4948bca2817337fdee5f`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:31.501825 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-97a1fe17-29f0-47c2-a11d-2d531e11eb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:31.567312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 518/1022] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Jul 12 18:47:31 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:47:31.573319 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d2907-0ef8-4822-8ab7-ffac9365fb73 service nova] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:31.583504 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d2907-0ef8-4822-8ab7-ffac9365fb73 service nova] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:31.587213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc3db5-7e72-4d2e-953b-62c27d9d383e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c0b548be2d4948bca2817337fdee5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:31.587882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3db5-7e72-4d2e-953b-62c27d9d383e service glance] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:31.588173 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3db5-7e72-4d2e-953b-62c27d9d383e service glance] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:31.588453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3db5-7e72-4d2e-953b-62c27d9d383e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:31.598525 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc3db5-7e72-4d2e-953b-62c27d9d383e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:31.599976 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc3db5-7e72-4d2e-953b-62c27d9d383e service glance] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:31.611207 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 505/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:33.833007 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36138e-457d-41cd-aaa7-5f2ee07195fd None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:33.833733 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36138e-457d-41cd-aaa7-5f2ee07195fd None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:33.833733 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36138e-457d-41cd-aaa7-5f2ee07195fd None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:33.835183 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 519/1024] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:33.840530 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ef00b-daac-4397-8613-94d31461b8ac None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:33.841010 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ef00b-daac-4397-8613-94d31461b8ac None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:33.841142 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ef00b-daac-4397-8613-94d31461b8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:33.859202 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-6d0ef00b-daac-4397-8613-94d31461b8ac None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:33.863861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-6d0ef00b-daac-4397-8613-94d31461b8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:33.874397 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 506/1025] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:47:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:33.920680 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36138e-457d-41cd-aaa7-5f2ee07195fd None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:33.937405 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36138e-457d-41cd-aaa7-5f2ee07195fd None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:33.942540 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108f910-4650-49e0-980e-ee9680352dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:33.943250 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f910-4650-49e0-980e-ee9680352dfc service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:33.943599 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f910-4650-49e0-980e-ee9680352dfc service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:33.943940 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108f910-4650-49e0-980e-ee9680352dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:33.952691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f910-4650-49e0-980e-ee9680352dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:33.954372 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108f910-4650-49e0-980e-ee9680352dfc service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:33.964058 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 520/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:43.853565 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=37 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:43.959733 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=41 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:46.795369 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd9e25-7a08-4e96-a950-d86e1a43bfed None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:46.796060 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd9e25-7a08-4e96-a950-d86e1a43bfed None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:46.796060 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd9e25-7a08-4e96-a950-d86e1a43bfed None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:46.797344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 507/1027] 10.222.0.16 () {54 vars in 918 bytes} [Tue Jul 12 18:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:46.802504 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d98a-87b2-4876-b59f-b4c9f93e9714 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:46.802950 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d98a-87b2-4876-b59f-b4c9f93e9714 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:46.803094 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63d98a-87b2-4876-b59f-b4c9f93e9714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:46.821511 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-6f63d98a-87b2-4876-b59f-b4c9f93e9714 None None] MFA Rules not processed for user `ce92f306929849f98a89e3dadb26cb37`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:46.822705 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-6f63d98a-87b2-4876-b59f-b4c9f93e9714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:46.831901 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 521/1028] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Jul 12 18:47:46 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:46.845894 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d51ff4-eda8-40e4-a38d-580313a5cbe5 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:46.846186 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d51ff4-eda8-40e4-a38d-580313a5cbe5 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:46.846467 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d51ff4-eda8-40e4-a38d-580313a5cbe5 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:46.847807 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 508/1029] 10.222.0.16 () {54 vars in 918 bytes} [Tue Jul 12 18:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:46.852199 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb089b1-247b-4bf8-be36-eacfa93d917a None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:46.852478 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb089b1-247b-4bf8-be36-eacfa93d917a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:46.852753 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb089b1-247b-4bf8-be36-eacfa93d917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:46.870640 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-8bb089b1-247b-4bf8-be36-eacfa93d917a None None] MFA Rules not processed for user `72918f9adc4240d99640b419e013b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:46.872333 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-8bb089b1-247b-4bf8-be36-eacfa93d917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:46.880745 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 522/1030] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Jul 12 18:47:46 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:49.562315 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814188e6-e79c-47c9-b3f8-cfde581945a2 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:49.562950 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814188e6-e79c-47c9-b3f8-cfde581945a2 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:49.562950 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814188e6-e79c-47c9-b3f8-cfde581945a2 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:49.564224 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 509/1031] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:49.570642 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867406c-bd57-43a5-aa21-78715f7c4869 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:49.571301 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867406c-bd57-43a5-aa21-78715f7c4869 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:49.571301 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867406c-bd57-43a5-aa21-78715f7c4869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:49.590400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-c867406c-bd57-43a5-aa21-78715f7c4869 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:49.591588 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-c867406c-bd57-43a5-aa21-78715f7c4869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:49.599587 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 523/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:47:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:49.642371 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814188e6-e79c-47c9-b3f8-cfde581945a2 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:49.656695 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814188e6-e79c-47c9-b3f8-cfde581945a2 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:49.661989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd72dc4-7a96-4652-af47-c779533eeeef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:49.662630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd72dc4-7a96-4652-af47-c779533eeeef service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:49.662912 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd72dc4-7a96-4652-af47-c779533eeeef service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:49.663188 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd72dc4-7a96-4652-af47-c779533eeeef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:49.671282 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd72dc4-7a96-4652-af47-c779533eeeef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:49.672853 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd72dc4-7a96-4652-af47-c779533eeeef service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:49.682021 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 510/1033] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:50.613163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ea660-3060-4f95-9605-0201a0f3f2c7 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:50.613807 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ea660-3060-4f95-9605-0201a0f3f2c7 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:50.613807 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ea660-3060-4f95-9605-0201a0f3f2c7 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:50.615100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 524/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:50.619898 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9506b0-5ba9-428a-8a11-8b26dcc42d03 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:50.620294 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9506b0-5ba9-428a-8a11-8b26dcc42d03 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:50.620459 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9506b0-5ba9-428a-8a11-8b26dcc42d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:50.638916 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-fd9506b0-5ba9-428a-8a11-8b26dcc42d03 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:50.640088 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-fd9506b0-5ba9-428a-8a11-8b26dcc42d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:50.647618 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 511/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:47:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:50.864361 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ea660-3060-4f95-9605-0201a0f3f2c7 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:50.878124 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ea660-3060-4f95-9605-0201a0f3f2c7 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:50.883042 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33653b32-af5e-469c-ace6-c3427abdd1cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:50.883680 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33653b32-af5e-469c-ace6-c3427abdd1cc service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:50.883960 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33653b32-af5e-469c-ace6-c3427abdd1cc service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:50.884237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33653b32-af5e-469c-ace6-c3427abdd1cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:50.892626 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33653b32-af5e-469c-ace6-c3427abdd1cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:50.894222 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33653b32-af5e-469c-ace6-c3427abdd1cc service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:50.903342 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 525/1036] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:51.802307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5644f1-f77f-4080-9673-2a67ddc0afcd None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:51.802850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5644f1-f77f-4080-9673-2a67ddc0afcd None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:51.802850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5644f1-f77f-4080-9673-2a67ddc0afcd None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:51.804222 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 512/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:51.809002 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c595-db56-4f25-b974-89b0881a9ea4 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:51.809409 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c595-db56-4f25-b974-89b0881a9ea4 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:51.809575 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398c595-db56-4f25-b974-89b0881a9ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:51.827068 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-2398c595-db56-4f25-b974-89b0881a9ea4 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:51.828264 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-2398c595-db56-4f25-b974-89b0881a9ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:51.835819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 526/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:47:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:51.992815 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5644f1-f77f-4080-9673-2a67ddc0afcd None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:52.009548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5644f1-f77f-4080-9673-2a67ddc0afcd None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:52.014398 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e40a20-3928-4b5b-b82b-fef585068c73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:52.015030 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40a20-3928-4b5b-b82b-fef585068c73 service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:52.015307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40a20-3928-4b5b-b82b-fef585068c73 service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:52.015575 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e40a20-3928-4b5b-b82b-fef585068c73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:52.023349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e40a20-3928-4b5b-b82b-fef585068c73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:52.024896 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e40a20-3928-4b5b-b82b-fef585068c73 service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:52.034383 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 513/1039] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:52.889899 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69a37c-cbc4-4f91-b48c-ebc57d3060eb None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:52.890312 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69a37c-cbc4-4f91-b48c-ebc57d3060eb None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:52.890453 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69a37c-cbc4-4f91-b48c-ebc57d3060eb None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:52.891819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 527/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:52.896587 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809645ec-8639-4b92-bb08-89086576f157 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:52.897006 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809645ec-8639-4b92-bb08-89086576f157 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:52.897149 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809645ec-8639-4b92-bb08-89086576f157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:52.914974 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-809645ec-8639-4b92-bb08-89086576f157 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:52.916157 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-809645ec-8639-4b92-bb08-89086576f157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:52.924462 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 514/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:47:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:53.078115 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69a37c-cbc4-4f91-b48c-ebc57d3060eb None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:53.091167 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69a37c-cbc4-4f91-b48c-ebc57d3060eb None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:53.095983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e255d11-9481-4e69-b861-83b52696d516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:53.096610 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e255d11-9481-4e69-b861-83b52696d516 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:53.096890 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e255d11-9481-4e69-b861-83b52696d516 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:53.097166 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e255d11-9481-4e69-b861-83b52696d516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:53.105145 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e255d11-9481-4e69-b861-83b52696d516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:53.106739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e255d11-9481-4e69-b861-83b52696d516 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:53.116523 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 528/1042] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:53.981641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c9739-a6b0-4092-88fe-a161dba8d74e None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:53.982062 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c9739-a6b0-4092-88fe-a161dba8d74e None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:53.982730 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c9739-a6b0-4092-88fe-a161dba8d74e None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:53.984116 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 515/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:53.989080 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c37dc-e5ec-4e23-8a42-e4266c9a3d48 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:53.991735 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c37dc-e5ec-4e23-8a42-e4266c9a3d48 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:53.992045 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c37dc-e5ec-4e23-8a42-e4266c9a3d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:54.019267 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-af0c37dc-e5ec-4e23-8a42-e4266c9a3d48 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:54.020455 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-af0c37dc-e5ec-4e23-8a42-e4266c9a3d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:54.028112 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 529/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:47:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:54.184813 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c9739-a6b0-4092-88fe-a161dba8d74e None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:54.197713 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c9739-a6b0-4092-88fe-a161dba8d74e None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:54.202555 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dffc5-c557-4e23-8bcf-80c5e80ac8df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:54.203179 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dffc5-c557-4e23-8bcf-80c5e80ac8df service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:54.203454 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dffc5-c557-4e23-8bcf-80c5e80ac8df service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:54.203722 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dffc5-c557-4e23-8bcf-80c5e80ac8df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:54.211441 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dffc5-c557-4e23-8bcf-80c5e80ac8df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:54.212998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dffc5-c557-4e23-8bcf-80c5e80ac8df service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:54.222464 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 516/1045] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:55.027022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48fa0b-9559-478d-9108-d26479228846 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:55.027593 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48fa0b-9559-478d-9108-d26479228846 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:55.027593 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48fa0b-9559-478d-9108-d26479228846 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:55.028930 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 530/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:55.033855 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170fad6-8866-45bd-9819-eeedf65b74f9 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:55.034299 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170fad6-8866-45bd-9819-eeedf65b74f9 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:55.034394 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170fad6-8866-45bd-9819-eeedf65b74f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:55.052170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-6170fad6-8866-45bd-9819-eeedf65b74f9 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:55.053397 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-6170fad6-8866-45bd-9819-eeedf65b74f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:55.061568 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 517/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:47:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:55.215884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48fa0b-9559-478d-9108-d26479228846 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:55.228792 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48fa0b-9559-478d-9108-d26479228846 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:55.234139 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f777a-335b-4920-8a51-7f2e49b9d224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:55.234761 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f777a-335b-4920-8a51-7f2e49b9d224 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:55.235035 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f777a-335b-4920-8a51-7f2e49b9d224 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:55.235303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f777a-335b-4920-8a51-7f2e49b9d224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:55.243090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f777a-335b-4920-8a51-7f2e49b9d224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:55.244637 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f777a-335b-4920-8a51-7f2e49b9d224 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:55.254351 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 531/1048] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:56.062528 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd214d-c195-4a98-b311-44dfa1564577 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:56.063072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd214d-c195-4a98-b311-44dfa1564577 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:56.063072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd214d-c195-4a98-b311-44dfa1564577 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:56.064437 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 518/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:47:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:47:56.069318 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164c498-ed2e-44e9-9974-8a152336bfd0 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:56.069747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164c498-ed2e-44e9-9974-8a152336bfd0 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:56.069850 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164c498-ed2e-44e9-9974-8a152336bfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:56.087296 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-e164c498-ed2e-44e9-9974-8a152336bfd0 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:56.088469 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-e164c498-ed2e-44e9-9974-8a152336bfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:56.096071 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 532/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:47:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:56.252113 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd214d-c195-4a98-b311-44dfa1564577 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:56.265101 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd214d-c195-4a98-b311-44dfa1564577 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:56.269836 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede971b-e653-456a-a37e-58f6508358ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:56.270457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede971b-e653-456a-a37e-58f6508358ff service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:56.270733 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede971b-e653-456a-a37e-58f6508358ff service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:56.271003 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede971b-e653-456a-a37e-58f6508358ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:56.279546 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede971b-e653-456a-a37e-58f6508358ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:56.281076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede971b-e653-456a-a37e-58f6508358ff service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:56.291087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 519/1051] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:57.104637 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee298f-e3b4-4296-8be4-7c72ee118e25 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:57.105194 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee298f-e3b4-4296-8be4-7c72ee118e25 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:57.105194 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee298f-e3b4-4296-8be4-7c72ee118e25 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:57.106631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 533/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:57.112074 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cef2f-ce09-4b05-90de-729441747d42 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:57.112522 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cef2f-ce09-4b05-90de-729441747d42 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:57.112664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cef2f-ce09-4b05-90de-729441747d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:57.130058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-7b5cef2f-ce09-4b05-90de-729441747d42 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:57.131231 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-7b5cef2f-ce09-4b05-90de-729441747d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:57.139000 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 520/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:47:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:57.293176 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee298f-e3b4-4296-8be4-7c72ee118e25 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:57.307573 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee298f-e3b4-4296-8be4-7c72ee118e25 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:57.312450 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b848e11-1509-48c2-88d8-887f7c5ca843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:57.313076 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b848e11-1509-48c2-88d8-887f7c5ca843 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:57.313391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b848e11-1509-48c2-88d8-887f7c5ca843 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:57.313669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b848e11-1509-48c2-88d8-887f7c5ca843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:57.321697 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b848e11-1509-48c2-88d8-887f7c5ca843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:57.323253 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b848e11-1509-48c2-88d8-887f7c5ca843 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:57.332396 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 534/1054] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:47:58.137641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf7da-12d1-4237-aa3b-f8b501c90cf1 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:58.138161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf7da-12d1-4237-aa3b-f8b501c90cf1 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:58.138161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cf7da-12d1-4237-aa3b-f8b501c90cf1 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:58.139516 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 521/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:47:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:47:58.144367 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353550c-60a8-4e12-80ee-4a89314142da None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:58.144807 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353550c-60a8-4e12-80ee-4a89314142da None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:58.144939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353550c-60a8-4e12-80ee-4a89314142da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:58.162578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-2353550c-60a8-4e12-80ee-4a89314142da None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:47:58.163740 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-2353550c-60a8-4e12-80ee-4a89314142da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:47:58.171756 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 535/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:47:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:47:58.325261 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf7da-12d1-4237-aa3b-f8b501c90cf1 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:47:58.342070 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cf7da-12d1-4237-aa3b-f8b501c90cf1 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:47:58.347140 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d68b2-c6b5-4fc9-876e-397812dbe19e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:47:58.347779 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d68b2-c6b5-4fc9-876e-397812dbe19e service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:47:58.348058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d68b2-c6b5-4fc9-876e-397812dbe19e service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:47:58.348333 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d68b2-c6b5-4fc9-876e-397812dbe19e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:47:58.356394 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d68b2-c6b5-4fc9-876e-397812dbe19e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:47:58.358505 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d68b2-c6b5-4fc9-876e-397812dbe19e service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:47:58.367626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 522/1057] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:47:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:00.482637 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57afa92-6d0c-4507-bd03-7187a8565442 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:00.483200 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57afa92-6d0c-4507-bd03-7187a8565442 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:00.483200 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57afa92-6d0c-4507-bd03-7187a8565442 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:00.484571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 536/1058] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:48:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:00.489927 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62685083-fdab-4f82-b0b6-b46dd4f71998 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:00.490328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62685083-fdab-4f82-b0b6-b46dd4f71998 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:00.490481 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62685083-fdab-4f82-b0b6-b46dd4f71998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:00.508460 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-62685083-fdab-4f82-b0b6-b46dd4f71998 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:00.509674 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-62685083-fdab-4f82-b0b6-b46dd4f71998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:00.517305 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 523/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:48:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:00.556070 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57afa92-6d0c-4507-bd03-7187a8565442 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:00.567075 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57afa92-6d0c-4507-bd03-7187a8565442 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:00.570508 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83481c-f22e-4174-9e30-e30de1377625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:00.571128 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83481c-f22e-4174-9e30-e30de1377625 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:00.571407 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83481c-f22e-4174-9e30-e30de1377625 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:00.571681 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83481c-f22e-4174-9e30-e30de1377625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:00.581188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83481c-f22e-4174-9e30-e30de1377625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:00.582629 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d83481c-f22e-4174-9e30-e30de1377625 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:00.591775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 537/1060] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:02.953915 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286e60-641b-47c8-9f5f-466d7904b52d None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:02.954439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286e60-641b-47c8-9f5f-466d7904b52d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:02.954600 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb286e60-641b-47c8-9f5f-466d7904b52d None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:02.956058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 524/1061] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:02.961601 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9be57f-ceb3-45c2-8300-a3b80786ce7a None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:02.962002 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9be57f-ceb3-45c2-8300-a3b80786ce7a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:02.962157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9be57f-ceb3-45c2-8300-a3b80786ce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:02.979282 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-dc9be57f-ceb3-45c2-8300-a3b80786ce7a None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:02.980460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-dc9be57f-ceb3-45c2-8300-a3b80786ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:02.988941 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 538/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:48:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:03.027156 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286e60-641b-47c8-9f5f-466d7904b52d None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:03.038291 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb286e60-641b-47c8-9f5f-466d7904b52d None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:03.041703 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8036661-0291-45aa-8d29-a51c95c7a053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:03.042325 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036661-0291-45aa-8d29-a51c95c7a053 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:03.042608 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036661-0291-45aa-8d29-a51c95c7a053 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:03.042884 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8036661-0291-45aa-8d29-a51c95c7a053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:03.052137 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8036661-0291-45aa-8d29-a51c95c7a053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:03.053589 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8036661-0291-45aa-8d29-a51c95c7a053 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:03.062634 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 525/1063] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:05.608698 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53462e8-b513-4431-ac7c-73202003c838 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:05.609231 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53462e8-b513-4431-ac7c-73202003c838 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:05.609378 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53462e8-b513-4431-ac7c-73202003c838 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:05.610701 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 539/1064] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:48:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:05.615980 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f783a6c-dd57-4d9e-96b0-4bab244e29e3 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:05.616409 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f783a6c-dd57-4d9e-96b0-4bab244e29e3 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:05.616542 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f783a6c-dd57-4d9e-96b0-4bab244e29e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:05.633817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-8f783a6c-dd57-4d9e-96b0-4bab244e29e3 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:05.634997 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-8f783a6c-dd57-4d9e-96b0-4bab244e29e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:05.643104 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 526/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:48:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:05.683360 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53462e8-b513-4431-ac7c-73202003c838 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:05.693659 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53462e8-b513-4431-ac7c-73202003c838 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:05.697105 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae200e-6dfc-443d-93da-01540ae2dae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:05.697751 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae200e-6dfc-443d-93da-01540ae2dae9 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:05.698030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae200e-6dfc-443d-93da-01540ae2dae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:05.698303 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae200e-6dfc-443d-93da-01540ae2dae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:05.707295 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae200e-6dfc-443d-93da-01540ae2dae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:05.708708 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae200e-6dfc-443d-93da-01540ae2dae9 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:05.718567 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 540/1066] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:08.112259 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3ef10-680b-452f-8a8d-933edd338e6c None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:08.112782 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3ef10-680b-452f-8a8d-933edd338e6c None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:08.112876 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3ef10-680b-452f-8a8d-933edd338e6c None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:08.114202 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 527/1067] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:08.119435 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c55bce-2ab5-43d3-9a3a-f43bc1092e37 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:08.119831 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c55bce-2ab5-43d3-9a3a-f43bc1092e37 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:08.119990 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c55bce-2ab5-43d3-9a3a-f43bc1092e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:08.137416 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-27c55bce-2ab5-43d3-9a3a-f43bc1092e37 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:08.139054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-27c55bce-2ab5-43d3-9a3a-f43bc1092e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:08.146794 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 541/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:48:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:08.186618 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3ef10-680b-452f-8a8d-933edd338e6c None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:08.197737 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3ef10-680b-452f-8a8d-933edd338e6c None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:08.201732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145677f3-b654-491e-ba4c-82da9ad8718f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:08.202369 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145677f3-b654-491e-ba4c-82da9ad8718f service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:08.202784 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145677f3-b654-491e-ba4c-82da9ad8718f service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:08.203067 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145677f3-b654-491e-ba4c-82da9ad8718f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:08.211885 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145677f3-b654-491e-ba4c-82da9ad8718f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:08.213358 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145677f3-b654-491e-ba4c-82da9ad8718f service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:08.223257 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 528/1069] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:10.496026 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f11ea-042b-4fa6-982e-4b282128211b None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:10.496546 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f11ea-042b-4fa6-982e-4b282128211b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:10.496546 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f11ea-042b-4fa6-982e-4b282128211b None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:10.498483 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 542/1070] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:10.503733 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd96dc3-7a62-47ec-80cd-9b5c19a23da7 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:10.504148 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd96dc3-7a62-47ec-80cd-9b5c19a23da7 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:10.504312 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd96dc3-7a62-47ec-80cd-9b5c19a23da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:10.522030 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-0bd96dc3-7a62-47ec-80cd-9b5c19a23da7 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:10.523197 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-0bd96dc3-7a62-47ec-80cd-9b5c19a23da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:10.530679 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 529/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:48:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:10.568570 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f11ea-042b-4fa6-982e-4b282128211b None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:10.579754 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f11ea-042b-4fa6-982e-4b282128211b None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:10.583294 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5450ffd-b60a-4a15-aae3-1b1f1eed5fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:10.583924 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5450ffd-b60a-4a15-aae3-1b1f1eed5fff service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:10.584206 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5450ffd-b60a-4a15-aae3-1b1f1eed5fff service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:10.584483 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5450ffd-b60a-4a15-aae3-1b1f1eed5fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:10.593324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5450ffd-b60a-4a15-aae3-1b1f1eed5fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:10.594734 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5450ffd-b60a-4a15-aae3-1b1f1eed5fff service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:10.603841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 543/1072] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:12.894975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068e331-ddfb-46b3-b45a-bed46878cd79 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:12.895442 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068e331-ddfb-46b3-b45a-bed46878cd79 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:12.895549 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068e331-ddfb-46b3-b45a-bed46878cd79 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:12.896912 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 530/1073] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:12.902208 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f7827-0065-4d19-b93f-ba3c43ff6230 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:12.902625 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f7827-0065-4d19-b93f-ba3c43ff6230 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:12.902755 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f7827-0065-4d19-b93f-ba3c43ff6230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:12.921436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-867f7827-0065-4d19-b93f-ba3c43ff6230 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:12.922602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-867f7827-0065-4d19-b93f-ba3c43ff6230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:12.930467 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 544/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:48:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:12.969102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068e331-ddfb-46b3-b45a-bed46878cd79 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:12.979590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068e331-ddfb-46b3-b45a-bed46878cd79 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:12.983605 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb34de3-ab37-4a3b-bbaa-c13f6b08b59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:12.984229 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb34de3-ab37-4a3b-bbaa-c13f6b08b59c service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:12.984511 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb34de3-ab37-4a3b-bbaa-c13f6b08b59c service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:12.984787 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb34de3-ab37-4a3b-bbaa-c13f6b08b59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:12.993471 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb34de3-ab37-4a3b-bbaa-c13f6b08b59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:12.994893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb34de3-ab37-4a3b-bbaa-c13f6b08b59c service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:13.003975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 531/1075] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:15.297043 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580f50-c499-4548-a0a6-86c5f655f2c2 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:15.297497 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580f50-c499-4548-a0a6-86c5f655f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:15.297638 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62580f50-c499-4548-a0a6-86c5f655f2c2 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:15.299088 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 545/1076] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:15.304558 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aa019-2a74-46a3-b6a4-ee942da5c18d None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:15.304959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aa019-2a74-46a3-b6a4-ee942da5c18d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:15.305118 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6aa019-2a74-46a3-b6a4-ee942da5c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:15.311106 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=70 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:15.326094 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-1e6aa019-2a74-46a3-b6a4-ee942da5c18d None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:15.327519 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-1e6aa019-2a74-46a3-b6a4-ee942da5c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:15.335182 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 532/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:48:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:15.374169 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62580f50-c499-4548-a0a6-86c5f655f2c2 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:15.379536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=73 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:15.385832 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62580f50-c499-4548-a0a6-86c5f655f2c2 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:15.389836 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328aa8a-4cb0-465b-aead-bb0ebfaaecca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:15.390499 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328aa8a-4cb0-465b-aead-bb0ebfaaecca service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:15.390781 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328aa8a-4cb0-465b-aead-bb0ebfaaecca service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:15.391059 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328aa8a-4cb0-465b-aead-bb0ebfaaecca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:15.399818 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328aa8a-4cb0-465b-aead-bb0ebfaaecca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:15.401229 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328aa8a-4cb0-465b-aead-bb0ebfaaecca service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:15.410963 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 546/1078] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:17.690579 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d52a2-b7a6-4a17-9ba7-b3b69f35ed2e None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:17.691113 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d52a2-b7a6-4a17-9ba7-b3b69f35ed2e None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:17.691113 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d52a2-b7a6-4a17-9ba7-b3b69f35ed2e None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:17.692491 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 533/1079] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:17.697891 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a730955-26ab-4d0b-b613-7a8f36e064b7 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:17.698335 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a730955-26ab-4d0b-b613-7a8f36e064b7 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:17.698432 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a730955-26ab-4d0b-b613-7a8f36e064b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:17.716176 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-8a730955-26ab-4d0b-b613-7a8f36e064b7 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:17.717413 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-8a730955-26ab-4d0b-b613-7a8f36e064b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:17.724943 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 547/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:48:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:17.764451 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d52a2-b7a6-4a17-9ba7-b3b69f35ed2e None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:17.774700 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d52a2-b7a6-4a17-9ba7-b3b69f35ed2e None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:17.778732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e70bf0-f879-4346-8b05-c513f7ea994e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:17.780731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70bf0-f879-4346-8b05-c513f7ea994e service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:17.782328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70bf0-f879-4346-8b05-c513f7ea994e service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:17.782610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e70bf0-f879-4346-8b05-c513f7ea994e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:17.792284 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e70bf0-f879-4346-8b05-c513f7ea994e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:17.793741 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e70bf0-f879-4346-8b05-c513f7ea994e service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:17.803244 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 534/1081] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:20.042680 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5303cf-e18f-4278-9ce6-726e60b7d18b None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:20.043186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5303cf-e18f-4278-9ce6-726e60b7d18b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:20.043288 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5303cf-e18f-4278-9ce6-726e60b7d18b None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:20.044629 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 548/1082] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:20.049768 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9c7eb-ad87-4673-a3cd-34a174a8f7ce None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:20.050192 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9c7eb-ad87-4673-a3cd-34a174a8f7ce None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:20.050327 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9c7eb-ad87-4673-a3cd-34a174a8f7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:20.067541 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-5ed9c7eb-ad87-4673-a3cd-34a174a8f7ce None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:20.068750 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-5ed9c7eb-ad87-4673-a3cd-34a174a8f7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:20.076910 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 535/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:48:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:20.114180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5303cf-e18f-4278-9ce6-726e60b7d18b None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:20.124607 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5303cf-e18f-4278-9ce6-726e60b7d18b None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:20.128065 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487ebdf-25b3-4028-8819-3af5e1ac8beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:20.128688 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487ebdf-25b3-4028-8819-3af5e1ac8beb service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:20.129219 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487ebdf-25b3-4028-8819-3af5e1ac8beb service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:20.129529 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487ebdf-25b3-4028-8819-3af5e1ac8beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:20.139203 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487ebdf-25b3-4028-8819-3af5e1ac8beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:20.140551 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487ebdf-25b3-4028-8819-3af5e1ac8beb service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:20.149829 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 549/1084] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:22.425011 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd4a86-bb9e-4613-a817-03198d65f823 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:22.425601 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd4a86-bb9e-4613-a817-03198d65f823 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:22.425601 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd4a86-bb9e-4613-a817-03198d65f823 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:22.426966 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 536/1085] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:22.432233 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63abc51-09c4-4b48-8dda-cdbdf644e3b1 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:22.432624 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63abc51-09c4-4b48-8dda-cdbdf644e3b1 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:22.432779 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63abc51-09c4-4b48-8dda-cdbdf644e3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:22.450517 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-e63abc51-09c4-4b48-8dda-cdbdf644e3b1 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:22.452198 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-e63abc51-09c4-4b48-8dda-cdbdf644e3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:22.459856 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 550/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:48:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:22.497632 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd4a86-bb9e-4613-a817-03198d65f823 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:22.508646 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd4a86-bb9e-4613-a817-03198d65f823 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:22.512242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd379b-9ed6-4851-a77f-3b3744272413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:22.512857 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd379b-9ed6-4851-a77f-3b3744272413 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:22.513139 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd379b-9ed6-4851-a77f-3b3744272413 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:22.513496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd379b-9ed6-4851-a77f-3b3744272413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:22.523008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd379b-9ed6-4851-a77f-3b3744272413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:22.524433 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd379b-9ed6-4851-a77f-3b3744272413 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:22.533652 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 537/1087] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:32.445574 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=17 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:32.529674 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=17 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:46.112520 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87417e-7deb-4d20-a827-01e364020082 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:46.113056 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87417e-7deb-4d20-a827-01e364020082 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:46.113056 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87417e-7deb-4d20-a827-01e364020082 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:46.114483 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 551/1088] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:46.119588 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7bb61-1290-4f6b-80ae-325d06dc21c0 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:46.119988 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7bb61-1290-4f6b-80ae-325d06dc21c0 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:46.120148 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c7bb61-1290-4f6b-80ae-325d06dc21c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:46.137603 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-a3c7bb61-1290-4f6b-80ae-325d06dc21c0 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:46.139234 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-a3c7bb61-1290-4f6b-80ae-325d06dc21c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:46.146844 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 538/1089] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:48:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:46.196494 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7ebed-3f47-4812-bfe5-4b9d0a46c268 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:46.196858 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7ebed-3f47-4812-bfe5-4b9d0a46c268 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:46.197148 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7ebed-3f47-4812-bfe5-4b9d0a46c268 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:46.198541 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 552/1090] 10.222.0.16 () {54 vars in 962 bytes} [Tue Jul 12 18:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:46.204307 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0d207-8308-4583-894a-8e9d21d6b61a None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:46.204595 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0d207-8308-4583-894a-8e9d21d6b61a None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:46.204873 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0d207-8308-4583-894a-8e9d21d6b61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:46.224131 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-53d0d207-8308-4583-894a-8e9d21d6b61a None None] MFA Rules not processed for user `86c0b548be2d4948bca2817337fdee5f`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:46.225361 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-53d0d207-8308-4583-894a-8e9d21d6b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:46.231735 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 539/1091] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Jul 12 18:48:46 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:46.239195 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7ebed-3f47-4812-bfe5-4b9d0a46c268 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:46.250098 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7ebed-3f47-4812-bfe5-4b9d0a46c268 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:46.253927 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afb0d2-01b6-4df2-8c2b-7fb0e2cd7611 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c0b548be2d4948bca2817337fdee5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:46.254557 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afb0d2-01b6-4df2-8c2b-7fb0e2cd7611 service glance] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:46.254839 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afb0d2-01b6-4df2-8c2b-7fb0e2cd7611 service glance] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:46.255129 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afb0d2-01b6-4df2-8c2b-7fb0e2cd7611 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:46.264341 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afb0d2-01b6-4df2-8c2b-7fb0e2cd7611 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:46.265797 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afb0d2-01b6-4df2-8c2b-7fb0e2cd7611 service glance] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:46.275180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 553/1092] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:48:48.603361 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4257e-7f67-4396-97a4-410eeaa3f208 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:48.604009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4257e-7f67-4396-97a4-410eeaa3f208 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:48.604009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4257e-7f67-4396-97a4-410eeaa3f208 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:48.605270 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 540/1093] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:48.610450 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15233-98b9-4a73-bc06-dda64dd121f7 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:48.610854 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15233-98b9-4a73-bc06-dda64dd121f7 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:48.611015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd15233-98b9-4a73-bc06-dda64dd121f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:48.628295 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-8fd15233-98b9-4a73-bc06-dda64dd121f7 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:48.629516 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-8fd15233-98b9-4a73-bc06-dda64dd121f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:48.637388 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 554/1094] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:48:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:48.662610 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4257e-7f67-4396-97a4-410eeaa3f208 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:48.674769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4257e-7f67-4396-97a4-410eeaa3f208 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:48.679065 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9e8c2-0bc3-4876-9fc4-6f927b287a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:48.679699 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e8c2-0bc3-4876-9fc4-6f927b287a4f admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:48.679979 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e8c2-0bc3-4876-9fc4-6f927b287a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:48.680251 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9e8c2-0bc3-4876-9fc4-6f927b287a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:48.680971 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9e8c2-0bc3-4876-9fc4-6f927b287a4f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:48.682801 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WARNING py.warnings [None req-f4e9e8c2-0bc3-4876-9fc4-6f927b287a4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:48:48.682801 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: warnings.warn(msg) Jul 12 18:48:48.682801 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: Jul 12 18:48:48.683917 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9e8c2-0bc3-4876-9fc4-6f927b287a4f admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:48.701945 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 541/1095] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Jul 12 18:48:48 2022] GET /identity/v3/projects => generated 1606 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:48:50.955787 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c77fc6-77ad-44c0-a017-58f081e07d1a None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:50.956299 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c77fc6-77ad-44c0-a017-58f081e07d1a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:50.956414 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c77fc6-77ad-44c0-a017-58f081e07d1a None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:50.957808 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 555/1096] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:50.963008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8a0df-848d-4703-86be-178ad058f941 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:50.963405 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8a0df-848d-4703-86be-178ad058f941 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:50.963578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8a0df-848d-4703-86be-178ad058f941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:50.982411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-58f8a0df-848d-4703-86be-178ad058f941 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:50.983602 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-58f8a0df-848d-4703-86be-178ad058f941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:50.991276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 542/1097] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:48:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:48:51.035206 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c77fc6-77ad-44c0-a017-58f081e07d1a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:51.048947 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c77fc6-77ad-44c0-a017-58f081e07d1a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:51.053766 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d68bd-c2ba-4c40-a94f-a3bdb69a9e8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:51.054389 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d68bd-c2ba-4c40-a94f-a3bdb69a9e8d service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:51.054669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d68bd-c2ba-4c40-a94f-a3bdb69a9e8d service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:51.054943 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d68bd-c2ba-4c40-a94f-a3bdb69a9e8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:51.063260 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d68bd-c2ba-4c40-a94f-a3bdb69a9e8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:51.064806 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d68bd-c2ba-4c40-a94f-a3bdb69a9e8d service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:51.073850 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 556/1098] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:53.499706 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26121-dc5b-43eb-8a11-89b5d2beefc2 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:53.500245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26121-dc5b-43eb-8a11-89b5d2beefc2 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:53.500245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb26121-dc5b-43eb-8a11-89b5d2beefc2 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:53.501670 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 543/1099] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:53.506840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4132a-9a5e-4c56-b100-5ce7d42aa4c6 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:53.507217 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4132a-9a5e-4c56-b100-5ce7d42aa4c6 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:53.507397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4132a-9a5e-4c56-b100-5ce7d42aa4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:53.525228 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-edb4132a-9a5e-4c56-b100-5ce7d42aa4c6 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:53.526435 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-edb4132a-9a5e-4c56-b100-5ce7d42aa4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:53.534051 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 557/1100] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:48:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:53.571101 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb26121-dc5b-43eb-8a11-89b5d2beefc2 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:53.583837 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb26121-dc5b-43eb-8a11-89b5d2beefc2 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:53.588422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4f2951-d63c-496c-902c-c8f4fd516bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:53.589102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f2951-d63c-496c-902c-c8f4fd516bdd service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:53.590076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f2951-d63c-496c-902c-c8f4fd516bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:53.590076 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4f2951-d63c-496c-902c-c8f4fd516bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:53.599304 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f2951-d63c-496c-902c-c8f4fd516bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:53.600744 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4f2951-d63c-496c-902c-c8f4fd516bdd service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:53.610682 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 544/1101] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:55.891651 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb596d-b1d4-4e56-a869-118541cd6e06 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:55.892136 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb596d-b1d4-4e56-a869-118541cd6e06 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:55.892242 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb596d-b1d4-4e56-a869-118541cd6e06 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:55.893616 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 558/1102] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:55.898728 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dd01b-0a8c-409e-a50b-09b013c1143e None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:55.899158 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dd01b-0a8c-409e-a50b-09b013c1143e None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:55.899318 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dd01b-0a8c-409e-a50b-09b013c1143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:55.916618 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-618dd01b-0a8c-409e-a50b-09b013c1143e None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:55.917829 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-618dd01b-0a8c-409e-a50b-09b013c1143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:55.925888 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 545/1103] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:48:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:55.963889 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb596d-b1d4-4e56-a869-118541cd6e06 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:55.974208 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb596d-b1d4-4e56-a869-118541cd6e06 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:55.977672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831ace3-cbcd-4d79-89cc-3e1b07193a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:55.978374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831ace3-cbcd-4d79-89cc-3e1b07193a75 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:55.978651 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831ace3-cbcd-4d79-89cc-3e1b07193a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:55.978921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831ace3-cbcd-4d79-89cc-3e1b07193a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:55.988067 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831ace3-cbcd-4d79-89cc-3e1b07193a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:55.989503 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831ace3-cbcd-4d79-89cc-3e1b07193a75 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:55.999316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 559/1104] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:48:58.325347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741892ee-7e86-4a90-a85d-a2a247898aef None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:58.325901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741892ee-7e86-4a90-a85d-a2a247898aef None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:58.325901 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741892ee-7e86-4a90-a85d-a2a247898aef None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:58.327245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 546/1105] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:48:58.332309 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1fc1d-7128-4b1a-84ce-fefddeb540c8 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:58.332685 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1fc1d-7128-4b1a-84ce-fefddeb540c8 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:58.332855 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1fc1d-7128-4b1a-84ce-fefddeb540c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:58.349846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-71e1fc1d-7128-4b1a-84ce-fefddeb540c8 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:48:58.351015 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-71e1fc1d-7128-4b1a-84ce-fefddeb540c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:48:58.359109 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 560/1106] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:48:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:48:58.399472 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741892ee-7e86-4a90-a85d-a2a247898aef None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:48:58.410077 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741892ee-7e86-4a90-a85d-a2a247898aef None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:48:58.413844 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ad2a6-8229-4e26-9fb3-3bf551cb2f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:48:58.414474 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ad2a6-8229-4e26-9fb3-3bf551cb2f21 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:48:58.414754 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ad2a6-8229-4e26-9fb3-3bf551cb2f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:48:58.415027 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ad2a6-8229-4e26-9fb3-3bf551cb2f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:48:58.424204 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ad2a6-8229-4e26-9fb3-3bf551cb2f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:48:58.425667 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ad2a6-8229-4e26-9fb3-3bf551cb2f21 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:48:58.434784 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 547/1107] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:48:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:49:00.834707 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d2a28-dd92-47cc-91a1-218773389e00 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:49:00.835265 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d2a28-dd92-47cc-91a1-218773389e00 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:49:00.835265 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d2a28-dd92-47cc-91a1-218773389e00 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:49:00.836616 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 561/1108] 10.222.0.16 () {54 vars in 926 bytes} [Tue Jul 12 18:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:49:00.841738 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c026-7003-4254-a151-a94711be6692 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:49:00.842148 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c026-7003-4254-a151-a94711be6692 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:49:00.842299 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2c026-7003-4254-a151-a94711be6692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:49:00.859553 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-a2f2c026-7003-4254-a151-a94711be6692 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:49:00.860747 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-a2f2c026-7003-4254-a151-a94711be6692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:49:00.868522 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 548/1109] 10.222.0.16 () {58 vars in 1023 bytes} [Tue Jul 12 18:49:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:49:00.908094 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d2a28-dd92-47cc-91a1-218773389e00 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:49:00.918804 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d2a28-dd92-47cc-91a1-218773389e00 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:49:00.922277 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca8b0e-27d1-4f0d-b348-386d045c0f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:49:00.922905 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca8b0e-27d1-4f0d-b348-386d045c0f17 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:49:00.923185 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca8b0e-27d1-4f0d-b348-386d045c0f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:49:00.923459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca8b0e-27d1-4f0d-b348-386d045c0f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:49:00.932107 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca8b0e-27d1-4f0d-b348-386d045c0f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:49:00.933546 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca8b0e-27d1-4f0d-b348-386d045c0f17 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:49:00.943136 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 562/1110] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:49:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:49:10.854672 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=33 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:49:10.939108 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=33 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:35.365588 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054df94-ddf0-4314-abb0-6e949ee1da2b None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.366235 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054df94-ddf0-4314-abb0-6e949ee1da2b None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.366235 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f054df94-ddf0-4314-abb0-6e949ee1da2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.384104 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-f054df94-ddf0-4314-abb0-6e949ee1da2b None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:50:35.385316 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-f054df94-ddf0-4314-abb0-6e949ee1da2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:50:35.393556 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 549/1111] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:50:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:50:35.401506 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecada492-51f9-4376-9fa2-54f586c0aa3c None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.401994 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecada492-51f9-4376-9fa2-54f586c0aa3c None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.402091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecada492-51f9-4376-9fa2-54f586c0aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.419286 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-ecada492-51f9-4376-9fa2-54f586c0aa3c None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:50:35.420980 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-ecada492-51f9-4376-9fa2-54f586c0aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:50:35.429179 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 563/1112] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:50:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:50:35.433688 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054df94-ddf0-4314-abb0-6e949ee1da2b None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:50:35.443665 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f054df94-ddf0-4314-abb0-6e949ee1da2b None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:50:35.448082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b69142-ecb2-4da0-9b35-aec9100466bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:50:35.448730 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b69142-ecb2-4da0-9b35-aec9100466bc admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.449009 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b69142-ecb2-4da0-9b35-aec9100466bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.449304 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b69142-ecb2-4da0-9b35-aec9100466bc admin admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.450025 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b69142-ecb2-4da0-9b35-aec9100466bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:50:35.450328 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b69142-ecb2-4da0-9b35-aec9100466bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:50:35.451899 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WARNING py.warnings [None req-f3b69142-ecb2-4da0-9b35-aec9100466bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:50:35.451899 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: warnings.warn(msg) Jul 12 18:50:35.451899 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: Jul 12 18:50:35.452770 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b69142-ecb2-4da0-9b35-aec9100466bc admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:50:35.463961 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 550/1113] 10.222.0.16 () {58 vars in 1152 bytes} [Tue Jul 12 18:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:50:35.471776 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecada492-51f9-4376-9fa2-54f586c0aa3c None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:50:35.480520 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecada492-51f9-4376-9fa2-54f586c0aa3c None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:50:35.484897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc42891-f4f9-4581-b45e-3a9a03ecfbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:50:35.485567 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc42891-f4f9-4581-b45e-3a9a03ecfbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.485847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc42891-f4f9-4581-b45e-3a9a03ecfbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.486117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc42891-f4f9-4581-b45e-3a9a03ecfbe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.486789 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc42891-f4f9-4581-b45e-3a9a03ecfbe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:50:35.488536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: WARNING py.warnings [None req-8cc42891-f4f9-4581-b45e-3a9a03ecfbe7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:50:35.488536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: warnings.warn(msg) Jul 12 18:50:35.488536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: Jul 12 18:50:35.489863 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc42891-f4f9-4581-b45e-3a9a03ecfbe7 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:50:35.514655 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 564/1114] 10.222.0.16 () {60 vars in 1152 bytes} [Tue Jul 12 18:50:35 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:50:35.518652 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b69142-ecb2-4da0-9b35-aec9100466bc admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:50:35.528245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b69142-ecb2-4da0-9b35-aec9100466bc admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:50:35.582681 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a8417-3f5a-49be-a223-4eb58442693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:50:35.583339 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a8417-3f5a-49be-a223-4eb58442693e admin admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.583620 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a8417-3f5a-49be-a223-4eb58442693e admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.583895 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a8417-3f5a-49be-a223-4eb58442693e admin admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.584586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a8417-3f5a-49be-a223-4eb58442693e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:50:35.585628 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WARNING py.warnings [None req-684a8417-3f5a-49be-a223-4eb58442693e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:50:35.585628 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: warnings.warn(msg) Jul 12 18:50:35.585628 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: Jul 12 18:50:35.586857 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a8417-3f5a-49be-a223-4eb58442693e admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:50:35.606201 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 551/1115] 10.222.0.16 () {60 vars in 1143 bytes} [Tue Jul 12 18:50:35 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:50:35.610710 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc42891-f4f9-4581-b45e-3a9a03ecfbe7 admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:50:35.620747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc42891-f4f9-4581-b45e-3a9a03ecfbe7 admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:50:35.625869 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a1385-a73f-42d7-859c-cbfa9dfc45bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:50:35.626512 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a1385-a73f-42d7-859c-cbfa9dfc45bd admin admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.626791 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a1385-a73f-42d7-859c-cbfa9dfc45bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.627063 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a1385-a73f-42d7-859c-cbfa9dfc45bd admin admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.627771 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a1385-a73f-42d7-859c-cbfa9dfc45bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:50:35.628762 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: WARNING py.warnings [None req-e02a1385-a73f-42d7-859c-cbfa9dfc45bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:50:35.628762 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: warnings.warn(msg) Jul 12 18:50:35.628762 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: Jul 12 18:50:35.629665 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a1385-a73f-42d7-859c-cbfa9dfc45bd admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:50:35.642387 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 565/1116] 10.222.0.16 () {58 vars in 1121 bytes} [Tue Jul 12 18:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:50:35.646198 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a8417-3f5a-49be-a223-4eb58442693e admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:50:35.655926 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a8417-3f5a-49be-a223-4eb58442693e admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:50:35.660577 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e0a11-4ed3-4f7e-b503-48d7feb896c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:50:35.661215 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e0a11-4ed3-4f7e-b503-48d7feb896c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.661699 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e0a11-4ed3-4f7e-b503-48d7feb896c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.661899 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e0a11-4ed3-4f7e-b503-48d7feb896c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.662592 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e0a11-4ed3-4f7e-b503-48d7feb896c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:50:35.663586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WARNING py.warnings [None req-422e0a11-4ed3-4f7e-b503-48d7feb896c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:50:35.663586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: warnings.warn(msg) Jul 12 18:50:35.663586 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: Jul 12 18:50:35.664450 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e0a11-4ed3-4f7e-b503-48d7feb896c9 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:50:35.678185 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 552/1117] 10.222.0.16 () {58 vars in 1121 bytes} [Tue Jul 12 18:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:50:35.682102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a1385-a73f-42d7-859c-cbfa9dfc45bd admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:50:35.692395 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a1385-a73f-42d7-859c-cbfa9dfc45bd admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:50:35.697040 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d92e5-439c-4184-9d00-6a439059490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:50:35.697946 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d92e5-439c-4184-9d00-6a439059490a admin admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.698230 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d92e5-439c-4184-9d00-6a439059490a admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.698508 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d92e5-439c-4184-9d00-6a439059490a admin admin] PATH_INFO: `/v3/projects/2f66d153b23e4159949b37e424bbda20/users/98f6d9f0c8694ec8996e5a9655dff067/roles/a6f65f08e2fc407cad745e9cd18f282d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.712618 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d92e5-439c-4184-9d00-6a439059490a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f66d153b23e4159949b37e424bbda20, user_id=98f6d9f0c8694ec8996e5a9655dff067, role_id=a6f65f08e2fc407cad745e9cd18f282d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:50:35.713675 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: WARNING py.warnings [None req-fd5d92e5-439c-4184-9d00-6a439059490a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:50:35.713675 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: warnings.warn(msg) Jul 12 18:50:35.713675 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: Jul 12 18:50:35.715578 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d92e5-439c-4184-9d00-6a439059490a admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:50:35.728560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 566/1118] 10.222.0.16 () {60 vars in 1482 bytes} [Tue Jul 12 18:50:35 2022] PUT /identity/v3/projects/2f66d153b23e4159949b37e424bbda20/users/98f6d9f0c8694ec8996e5a9655dff067/roles/a6f65f08e2fc407cad745e9cd18f282d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:50:35.740926 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9c621-b531-4078-aca7-20789eb5ae32 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.741216 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9c621-b531-4078-aca7-20789eb5ae32 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.741526 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9c621-b531-4078-aca7-20789eb5ae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.768496 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-59d9c621-b531-4078-aca7-20789eb5ae32 None None] MFA Rules not processed for user `98f6d9f0c8694ec8996e5a9655dff067`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:50:35.769739 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-59d9c621-b531-4078-aca7-20789eb5ae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:50:35.830687 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 553/1119] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:50:35 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:50:35.844186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4f0f9-0688-46a6-b747-99cd33c006a6 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.844481 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4f0f9-0688-46a6-b747-99cd33c006a6 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.844761 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4f0f9-0688-46a6-b747-99cd33c006a6 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.846240 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 567/1120] 10.222.0.16 () {54 vars in 963 bytes} [Tue Jul 12 18:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:50:35.851107 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa9d76-e3df-4311-ae38-29e0e16dc6f0 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.851396 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa9d76-e3df-4311-ae38-29e0e16dc6f0 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.851671 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafa9d76-e3df-4311-ae38-29e0e16dc6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.869101 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-fafa9d76-e3df-4311-ae38-29e0e16dc6f0 None None] MFA Rules not processed for user `a60cee165d0f46ef8078a91f03788410`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:50:35.870300 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-fafa9d76-e3df-4311-ae38-29e0e16dc6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:50:35.912564 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:35.920695 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 554/1121] 10.222.0.16 () {58 vars in 1060 bytes} [Tue Jul 12 18:50:35 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:50:35.928474 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4f0f9-0688-46a6-b747-99cd33c006a6 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:50:35.938914 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4f0f9-0688-46a6-b747-99cd33c006a6 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:50:35.942407 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d683797-e2e8-4580-bd5b-70c4925f358e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a60cee165d0f46ef8078a91f03788410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:50:35.943030 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d683797-e2e8-4580-bd5b-70c4925f358e service cinder] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.943308 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d683797-e2e8-4580-bd5b-70c4925f358e service cinder] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.943582 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d683797-e2e8-4580-bd5b-70c4925f358e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:35.952279 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d683797-e2e8-4580-bd5b-70c4925f358e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:50:35.953711 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d683797-e2e8-4580-bd5b-70c4925f358e service cinder] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:50:35.962537 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 568/1122] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:50:35 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:50:35.998665 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eae59-4b36-4405-83ec-4cdfca31f039 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:35.998944 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eae59-4b36-4405-83ec-4cdfca31f039 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:35.999217 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0eae59-4b36-4405-83ec-4cdfca31f039 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:36.000495 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 555/1123] 10.222.0.16 () {52 vars in 829 bytes} [Tue Jul 12 18:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:50:36.004362 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d683797-e2e8-4580-bd5b-70c4925f358e service cinder] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:50:36.064398 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d683797-e2e8-4580-bd5b-70c4925f358e service cinder] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:50:36.069213 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:50:36.070097 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:36.070372 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:36.070642 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] PATH_INFO: `/v3/users/98f6d9f0c8694ec8996e5a9655dff067` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:36.071809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f6d9f0c8694ec8996e5a9655dff067)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:50:36.072810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: WARNING py.warnings [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:50:36.072810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: warnings.warn(msg) Jul 12 18:50:36.072810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: Jul 12 18:50:36.074050 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:50:36.137328 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f6d9f0c8694ec8996e5a9655dff067'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:50:36.155809 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f6d9f0c8694ec8996e5a9655dff067'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:50:36.169239 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f6d9f0c8694ec8996e5a9655dff067'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:50:36.169979 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f6d9f0c8694ec8996e5a9655dff067'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:50:36.179507 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f6d9f0c8694ec8996e5a9655dff067'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:50:36.185945 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 569/1124] 10.222.0.16 () {58 vars in 1223 bytes} [Tue Jul 12 18:50:36 2022] DELETE /identity/v3/users/98f6d9f0c8694ec8996e5a9655dff067 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:50:36.190345 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea24a45-0120-4ffa-a731-28286646e3b9 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:36.190630 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea24a45-0120-4ffa-a731-28286646e3b9 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:36.190928 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea24a45-0120-4ffa-a731-28286646e3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:36.208225 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-eea24a45-0120-4ffa-a731-28286646e3b9 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:50:36.209498 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-eea24a45-0120-4ffa-a731-28286646e3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:50:36.267421 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 556/1125] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:50:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:50:36.276871 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:50:36.278280 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:50:36.283464 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:36.338184 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebe390-2e06-4846-b513-f6ddcfdbca4a admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:50:36.341778 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ef868-cbb5-49c1-aa85-9ae54d78ea04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:50:36.342414 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ef868-cbb5-49c1-aa85-9ae54d78ea04 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:36.342694 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ef868-cbb5-49c1-aa85-9ae54d78ea04 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:36.342969 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ef868-cbb5-49c1-aa85-9ae54d78ea04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:36.351785 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ef868-cbb5-49c1-aa85-9ae54d78ea04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:50:36.353195 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ef868-cbb5-49c1-aa85-9ae54d78ea04 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:50:36.362862 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 570/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:50:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:50:36.719256 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea24a45-0120-4ffa-a731-28286646e3b9 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:50:36.720758 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-eea24a45-0120-4ffa-a731-28286646e3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:50:36.733876 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea24a45-0120-4ffa-a731-28286646e3b9 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:50:36.738474 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:50:36.739364 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:50:36.739647 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:50:36.739925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] PATH_INFO: `/v3/projects/2f66d153b23e4159949b37e424bbda20` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:50:36.741121 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f66d153b23e4159949b37e424bbda20)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:50:36.742182 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WARNING py.warnings [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:50:36.742182 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: warnings.warn(msg) Jul 12 18:50:36.742182 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: Jul 12 18:50:36.743375 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:50:36.806358 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f66d153b23e4159949b37e424bbda20', 'request_id': 'req-45042c67-978b-4f09-b703-342888350b1c'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:50:36.819329 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f66d153b23e4159949b37e424bbda20', 'request_id': 'req-45042c67-978b-4f09-b703-342888350b1c'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:50:36.825519 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f66d153b23e4159949b37e424bbda20', 'request_id': 'req-45042c67-978b-4f09-b703-342888350b1c'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:50:36.839508 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] The token cache is being invalidate because project 2f66d153b23e4159949b37e424bbda20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93676) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:50:36.839790 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:50:36.840399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-45042c67-978b-4f09-b703-342888350b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:50:36.842565 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 557/1127] 10.222.0.16 () {58 vars in 1232 bytes} [Tue Jul 12 18:50:36 2022] DELETE /identity/v3/projects/2f66d153b23e4159949b37e424bbda20 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:50:46.358839 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=25 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:46.836572 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:57.104910 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63037-ffbb-464d-a998-918bf0e3b147 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:51:57.105557 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63037-ffbb-464d-a998-918bf0e3b147 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:51:57.105557 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d63037-ffbb-464d-a998-918bf0e3b147 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:51:57.107012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 571/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:51:57.111850 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501b1d-e485-43f2-9eb1-a4e9af6cb2df None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:51:57.112249 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501b1d-e485-43f2-9eb1-a4e9af6cb2df None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:51:57.112428 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7501b1d-e485-43f2-9eb1-a4e9af6cb2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:51:57.183842 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-a7501b1d-e485-43f2-9eb1-a4e9af6cb2df None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:51:57.184959 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-a7501b1d-e485-43f2-9eb1-a4e9af6cb2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:51:57.275005 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 558/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:51:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:51:57.436241 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d63037-ffbb-464d-a998-918bf0e3b147 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:51:57.438404 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-d1d63037-ffbb-464d-a998-918bf0e3b147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:51:57.524363 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d63037-ffbb-464d-a998-918bf0e3b147 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:51:57.529304 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fda85a-82f9-4f00-bdc7-25e3e74912a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:51:57.529952 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda85a-82f9-4f00-bdc7-25e3e74912a5 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:51:57.530237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda85a-82f9-4f00-bdc7-25e3e74912a5 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:51:57.530516 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fda85a-82f9-4f00-bdc7-25e3e74912a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:51:57.538456 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fda85a-82f9-4f00-bdc7-25e3e74912a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:51:57.540090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fda85a-82f9-4f00-bdc7-25e3e74912a5 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:51:57.549620 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 572/1130] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:51:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:51:58.379735 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4d9b9-c3c7-41c8-a5de-35fdb3a10025 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:51:58.380301 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4d9b9-c3c7-41c8-a5de-35fdb3a10025 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:51:58.380301 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4d9b9-c3c7-41c8-a5de-35fdb3a10025 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:51:58.381706 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 559/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:51:58.386455 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf0bb5-6477-4310-acbc-d06a11809ad1 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:51:58.386895 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf0bb5-6477-4310-acbc-d06a11809ad1 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:51:58.387022 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf0bb5-6477-4310-acbc-d06a11809ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:51:58.404669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-59bf0bb5-6477-4310-acbc-d06a11809ad1 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:51:58.405904 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-59bf0bb5-6477-4310-acbc-d06a11809ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:51:58.414204 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 573/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:51:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:51:58.568424 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4d9b9-c3c7-41c8-a5de-35fdb3a10025 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:51:58.582000 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4d9b9-c3c7-41c8-a5de-35fdb3a10025 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:51:58.586753 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71408c-9d0a-4deb-9fbd-17ea2bc236b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:51:58.587386 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71408c-9d0a-4deb-9fbd-17ea2bc236b5 service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:51:58.587666 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71408c-9d0a-4deb-9fbd-17ea2bc236b5 service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:51:58.587942 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71408c-9d0a-4deb-9fbd-17ea2bc236b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:51:58.596728 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71408c-9d0a-4deb-9fbd-17ea2bc236b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:51:58.598417 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71408c-9d0a-4deb-9fbd-17ea2bc236b5 service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:51:58.607802 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 560/1133] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:51:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:52:03.080604 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6c50-f2af-43b9-bd7c-2ba3933af09e None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:03.081212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6c50-f2af-43b9-bd7c-2ba3933af09e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:03.081212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6c50-f2af-43b9-bd7c-2ba3933af09e None None] PATH_INFO: `/v3` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:03.082483 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 574/1134] 10.222.0.64 () {54 vars in 925 bytes} [Tue Jul 12 18:52:03 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:52:03.098452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283136-432e-43c1-ada5-5e68629a34dd None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:03.098838 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283136-432e-43c1-ada5-5e68629a34dd None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:03.099003 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283136-432e-43c1-ada5-5e68629a34dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:03.125906 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-f3283136-432e-43c1-ada5-5e68629a34dd None None] MFA Rules not processed for user `ce92f306929849f98a89e3dadb26cb37`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:52:03.127087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-f3283136-432e-43c1-ada5-5e68629a34dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:03.179472 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:03.188748 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 561/1135] 10.222.0.64 () {58 vars in 1015 bytes} [Tue Jul 12 18:52:03 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:52:07.252359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796f1c-6b03-445f-aee0-50d2a36a8365 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:07.252874 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796f1c-6b03-445f-aee0-50d2a36a8365 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:07.252999 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796f1c-6b03-445f-aee0-50d2a36a8365 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:07.254301 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 575/1136] 10.222.0.16 () {54 vars in 960 bytes} [Tue Jul 12 18:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:52:07.260512 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9a8b4-4956-49ac-ba31-fef6718dfe25 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:07.260918 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9a8b4-4956-49ac-ba31-fef6718dfe25 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:07.261068 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9a8b4-4956-49ac-ba31-fef6718dfe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:07.281133 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-3cb9a8b4-4956-49ac-ba31-fef6718dfe25 None None] MFA Rules not processed for user `ce92f306929849f98a89e3dadb26cb37`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:52:07.282860 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-3cb9a8b4-4956-49ac-ba31-fef6718dfe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:07.291214 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 562/1137] 10.222.0.16 () {58 vars in 1057 bytes} [Tue Jul 12 18:52:07 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:52:07.299277 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796f1c-6b03-445f-aee0-50d2a36a8365 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:52:07.312363 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796f1c-6b03-445f-aee0-50d2a36a8365 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:52:07.317231 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494666c-b6b7-45e7-96c8-1cb2b7e53285 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce92f306929849f98a89e3dadb26cb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:52:07.317880 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494666c-b6b7-45e7-96c8-1cb2b7e53285 service placement] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:07.318211 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494666c-b6b7-45e7-96c8-1cb2b7e53285 service placement] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:07.318821 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494666c-b6b7-45e7-96c8-1cb2b7e53285 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:07.328192 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494666c-b6b7-45e7-96c8-1cb2b7e53285 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:52:07.329843 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494666c-b6b7-45e7-96c8-1cb2b7e53285 service placement] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:52:07.339300 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 576/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:52:07 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:52:09.840867 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded50b5-33ce-47ea-95a1-5ddcdd020b46 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:09.841457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded50b5-33ce-47ea-95a1-5ddcdd020b46 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:09.841457 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded50b5-33ce-47ea-95a1-5ddcdd020b46 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:09.842833 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 563/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:52:09.847524 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778728f1-a998-4d1c-a654-265fcc191842 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:09.847953 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778728f1-a998-4d1c-a654-265fcc191842 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:09.848096 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778728f1-a998-4d1c-a654-265fcc191842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:09.866124 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-778728f1-a998-4d1c-a654-265fcc191842 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:52:09.867297 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-778728f1-a998-4d1c-a654-265fcc191842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:09.874892 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 577/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:52:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:52:10.034505 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded50b5-33ce-47ea-95a1-5ddcdd020b46 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:52:10.047975 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded50b5-33ce-47ea-95a1-5ddcdd020b46 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:52:10.053037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015cec2-e25d-4431-9f86-c4dc7c214bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:52:10.053705 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015cec2-e25d-4431-9f86-c4dc7c214bea service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:10.053988 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015cec2-e25d-4431-9f86-c4dc7c214bea service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:10.054264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015cec2-e25d-4431-9f86-c4dc7c214bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:10.062049 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015cec2-e25d-4431-9f86-c4dc7c214bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:52:10.064167 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015cec2-e25d-4431-9f86-c4dc7c214bea service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:52:10.073270 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 564/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:52:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:52:10.894154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ff52-9975-4e2d-822a-c7dd702d0d18 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:10.894660 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ff52-9975-4e2d-822a-c7dd702d0d18 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:10.894755 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50ff52-9975-4e2d-822a-c7dd702d0d18 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:10.896074 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 578/1142] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:52:10.900859 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c4723-5d80-41ee-98ea-2d8b809d0ec9 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:10.901267 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c4723-5d80-41ee-98ea-2d8b809d0ec9 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:10.901438 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c4723-5d80-41ee-98ea-2d8b809d0ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:10.919422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-e02c4723-5d80-41ee-98ea-2d8b809d0ec9 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:52:10.920593 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-e02c4723-5d80-41ee-98ea-2d8b809d0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:10.929298 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 565/1143] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:52:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:52:11.087173 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ff52-9975-4e2d-822a-c7dd702d0d18 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:52:11.101061 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50ff52-9975-4e2d-822a-c7dd702d0d18 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:52:11.106012 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd474f1-78d5-4390-ae03-0b23592a885c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:52:11.106646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd474f1-78d5-4390-ae03-0b23592a885c service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:11.106924 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd474f1-78d5-4390-ae03-0b23592a885c service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:11.107197 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd474f1-78d5-4390-ae03-0b23592a885c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:11.115423 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd474f1-78d5-4390-ae03-0b23592a885c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:52:11.117010 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd474f1-78d5-4390-ae03-0b23592a885c service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:52:11.126717 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 579/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:52:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:52:15.262956 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191bd48-ccd4-4e7d-b1a3-2bfa09051665 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:15.263562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191bd48-ccd4-4e7d-b1a3-2bfa09051665 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:15.263562 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191bd48-ccd4-4e7d-b1a3-2bfa09051665 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:15.264882 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 566/1145] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:52:15.270494 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f081-4d32-4440-a565-fa3f84868669 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:15.270933 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f081-4d32-4440-a565-fa3f84868669 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:15.271057 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f081-4d32-4440-a565-fa3f84868669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:15.289495 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-4c96f081-4d32-4440-a565-fa3f84868669 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:52:15.290691 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-4c96f081-4d32-4440-a565-fa3f84868669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:15.298346 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 580/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:52:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:52:15.336342 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191bd48-ccd4-4e7d-b1a3-2bfa09051665 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:52:15.338031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-8191bd48-ccd4-4e7d-b1a3-2bfa09051665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:15.394090 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191bd48-ccd4-4e7d-b1a3-2bfa09051665 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:52:15.397563 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4a9dc-c97a-4676-8a04-906658865928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:52:15.398196 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a9dc-c97a-4676-8a04-906658865928 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:15.398478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a9dc-c97a-4676-8a04-906658865928 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:15.398751 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4a9dc-c97a-4676-8a04-906658865928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:15.407422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4a9dc-c97a-4676-8a04-906658865928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:52:15.408856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4a9dc-c97a-4676-8a04-906658865928 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:52:15.418079 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 567/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:52:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:52:17.623219 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afc5ff-1f1a-497b-906c-726a1aaaa33e None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:17.623756 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afc5ff-1f1a-497b-906c-726a1aaaa33e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:17.623756 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afc5ff-1f1a-497b-906c-726a1aaaa33e None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:17.625085 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 581/1148] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:52:17.630721 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e8963-ce1a-4c6d-a704-401734d322b3 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:17.631159 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e8963-ce1a-4c6d-a704-401734d322b3 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:17.631270 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e8963-ce1a-4c6d-a704-401734d322b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:17.649534 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-0a8e8963-ce1a-4c6d-a704-401734d322b3 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:52:17.650729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-0a8e8963-ce1a-4c6d-a704-401734d322b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:17.658477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 568/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:52:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:52:17.694823 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afc5ff-1f1a-497b-906c-726a1aaaa33e None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:52:17.705888 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afc5ff-1f1a-497b-906c-726a1aaaa33e None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:52:17.709293 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b744f-91be-4d48-8fa2-6e1d0065e086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:52:17.709936 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b744f-91be-4d48-8fa2-6e1d0065e086 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:17.710216 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b744f-91be-4d48-8fa2-6e1d0065e086 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:17.710491 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b744f-91be-4d48-8fa2-6e1d0065e086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:17.719629 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b744f-91be-4d48-8fa2-6e1d0065e086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:52:17.721035 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b744f-91be-4d48-8fa2-6e1d0065e086 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:52:17.730155 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 582/1150] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:52:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:52:21.364081 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4188b17-2d8f-437b-8909-9052fab24f32 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:21.364648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4188b17-2d8f-437b-8909-9052fab24f32 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:21.364648 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4188b17-2d8f-437b-8909-9052fab24f32 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:21.366038 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 569/1151] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:52:21.371247 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67648db2-0ba7-4051-8bca-acd5b524a6c2 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:21.371668 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67648db2-0ba7-4051-8bca-acd5b524a6c2 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:21.371795 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67648db2-0ba7-4051-8bca-acd5b524a6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:21.389501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-67648db2-0ba7-4051-8bca-acd5b524a6c2 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:52:21.390662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-67648db2-0ba7-4051-8bca-acd5b524a6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:21.398278 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 583/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:52:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:52:21.671361 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4188b17-2d8f-437b-8909-9052fab24f32 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:52:21.673884 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-b4188b17-2d8f-437b-8909-9052fab24f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:21.729205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4188b17-2d8f-437b-8909-9052fab24f32 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:52:21.732754 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fa606-753b-4796-9a11-2e430204723d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a60cee165d0f46ef8078a91f03788410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:52:21.733436 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fa606-753b-4796-9a11-2e430204723d service cinder] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:21.733720 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fa606-753b-4796-9a11-2e430204723d service cinder] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:21.733998 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fa606-753b-4796-9a11-2e430204723d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:21.743341 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fa606-753b-4796-9a11-2e430204723d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:52:21.744775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fa606-753b-4796-9a11-2e430204723d service cinder] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:52:21.754638 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 570/1153] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:52:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:52:23.984461 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dde5b3-c77a-4cda-8022-9118a4353f0b None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:23.985044 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dde5b3-c77a-4cda-8022-9118a4353f0b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:23.985044 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dde5b3-c77a-4cda-8022-9118a4353f0b None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:23.986422 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 584/1154] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:52:23.991615 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e48ff-08bc-4c74-9144-963b857120d5 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:23.992042 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e48ff-08bc-4c74-9144-963b857120d5 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:23.992212 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e48ff-08bc-4c74-9144-963b857120d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:24.009735 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-168e48ff-08bc-4c74-9144-963b857120d5 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:52:24.010925 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-168e48ff-08bc-4c74-9144-963b857120d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:24.019113 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 571/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:52:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:52:24.309327 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dde5b3-c77a-4cda-8022-9118a4353f0b None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:52:24.310975 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-16dde5b3-c77a-4cda-8022-9118a4353f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:52:24.324234 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dde5b3-c77a-4cda-8022-9118a4353f0b None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:52:24.327646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b2589-c365-43fd-8f97-3f87913c8fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a60cee165d0f46ef8078a91f03788410', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:52:24.328267 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2589-c365-43fd-8f97-3f87913c8fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:52:24.328544 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2589-c365-43fd-8f97-3f87913c8fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:52:24.328884 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b2589-c365-43fd-8f97-3f87913c8fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:52:24.337948 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b2589-c365-43fd-8f97-3f87913c8fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:52:24.339379 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b2589-c365-43fd-8f97-3f87913c8fa3 service cinder] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:52:24.348366 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 585/1156] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:52:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:52:34.004671 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=70 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:34.344391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=75 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:42.848604 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32550a-5047-43f8-9164-9a3581732354 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:42.849358 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32550a-5047-43f8-9164-9a3581732354 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:42.849358 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32550a-5047-43f8-9164-9a3581732354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:42.853170 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bb01b-86db-4329-a49b-d133b91427a6 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:42.853639 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bb01b-86db-4329-a49b-d133b91427a6 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:42.853738 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bb01b-86db-4329-a49b-d133b91427a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:42.867071 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-9c32550a-5047-43f8-9164-9a3581732354 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:53:42.868269 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-9c32550a-5047-43f8-9164-9a3581732354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:42.871100 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-7f1bb01b-86db-4329-a49b-d133b91427a6 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:53:42.872254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-7f1bb01b-86db-4329-a49b-d133b91427a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:42.877317 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 572/1157] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:53:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:53:42.883097 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 586/1158] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:53:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:53:42.884781 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a3806-0c22-4b64-96ed-3549630a1ca2 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:42.885074 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a3806-0c22-4b64-96ed-3549630a1ca2 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:42.885384 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a3806-0c22-4b64-96ed-3549630a1ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:42.890821 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b2867-899d-4069-bea2-e870b1e6cb94 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:42.891108 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b2867-899d-4069-bea2-e870b1e6cb94 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:42.891387 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b2867-899d-4069-bea2-e870b1e6cb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:42.903637 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-d18a3806-0c22-4b64-96ed-3549630a1ca2 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:53:42.904861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-d18a3806-0c22-4b64-96ed-3549630a1ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:42.908949 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-fe6b2867-899d-4069-bea2-e870b1e6cb94 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:53:42.910124 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-fe6b2867-899d-4069-bea2-e870b1e6cb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:42.912604 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 573/1159] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:53:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:53:42.917053 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a3806-0c22-4b64-96ed-3549630a1ca2 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:42.918069 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 587/1160] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:53:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:53:42.922277 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b2867-899d-4069-bea2-e870b1e6cb94 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:42.926117 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a3806-0c22-4b64-96ed-3549630a1ca2 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:42.930623 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772138-dd9b-43e8-8f10-5bddce595b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:42.931264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772138-dd9b-43e8-8f10-5bddce595b3a admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:42.931390 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b2867-899d-4069-bea2-e870b1e6cb94 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:42.931543 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772138-dd9b-43e8-8f10-5bddce595b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:42.931820 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94772138-dd9b-43e8-8f10-5bddce595b3a admin admin] PATH_INFO: `/v3/domains` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:42.932527 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94772138-dd9b-43e8-8f10-5bddce595b3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93676) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:53:42.932832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94772138-dd9b-43e8-8f10-5bddce595b3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:42.934454 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94772138-dd9b-43e8-8f10-5bddce595b3a admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:42.935948 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d01b0f-e176-4cf4-b1f2-99d69eabe747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:42.936579 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01b0f-e176-4cf4-b1f2-99d69eabe747 admin admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:42.936861 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01b0f-e176-4cf4-b1f2-99d69eabe747 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:42.937143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d01b0f-e176-4cf4-b1f2-99d69eabe747 admin admin] PATH_INFO: `/v3/domains` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:42.937885 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d01b0f-e176-4cf4-b1f2-99d69eabe747 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93675) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:53:42.938404 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d01b0f-e176-4cf4-b1f2-99d69eabe747 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:42.939921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: WARNING py.warnings [None req-38d01b0f-e176-4cf4-b1f2-99d69eabe747 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:53:42.939921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: warnings.warn(msg) Jul 12 18:53:42.939921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: Jul 12 18:53:42.940787 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d01b0f-e176-4cf4-b1f2-99d69eabe747 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:42.946387 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 574/1161] 10.222.0.16 () {58 vars in 1152 bytes} [Tue Jul 12 18:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:53:42.959400 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 588/1162] 10.222.0.16 () {58 vars in 1152 bytes} [Tue Jul 12 18:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:53:42.959568 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772138-dd9b-43e8-8f10-5bddce595b3a admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:42.960287 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d01b0f-e176-4cf4-b1f2-99d69eabe747 admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:42.964399 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94772138-dd9b-43e8-8f10-5bddce595b3a admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:42.968963 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f0f9c-4c26-47a2-b3fd-2826d008c5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:42.969619 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f0f9c-4c26-47a2-b3fd-2826d008c5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:42.969761 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d01b0f-e176-4cf4-b1f2-99d69eabe747 admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:42.969898 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f0f9c-4c26-47a2-b3fd-2826d008c5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:42.970170 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f0f9c-4c26-47a2-b3fd-2826d008c5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:42.970843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f0f9c-4c26-47a2-b3fd-2826d008c5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:42.971865 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WARNING py.warnings [None req-9d3f0f9c-4c26-47a2-b3fd-2826d008c5d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:53:42.971865 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: warnings.warn(msg) Jul 12 18:53:42.971865 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: Jul 12 18:53:42.973242 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f0f9c-4c26-47a2-b3fd-2826d008c5d7 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:42.974460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b7e32-5fc8-4cc9-a332-6551db5bb967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:42.975084 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7e32-5fc8-4cc9-a332-6551db5bb967 admin admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:42.975363 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7e32-5fc8-4cc9-a332-6551db5bb967 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:42.975639 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b7e32-5fc8-4cc9-a332-6551db5bb967 admin admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:42.976310 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b7e32-5fc8-4cc9-a332-6551db5bb967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:42.978212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b7e32-5fc8-4cc9-a332-6551db5bb967 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.010848 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 575/1163] 10.222.0.16 () {60 vars in 1152 bytes} [Tue Jul 12 18:53:42 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:53:43.014682 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 589/1164] 10.222.0.16 () {60 vars in 1152 bytes} [Tue Jul 12 18:53:42 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:53:43.015081 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f0f9c-4c26-47a2-b3fd-2826d008c5d7 admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:43.019221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b7e32-5fc8-4cc9-a332-6551db5bb967 admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:43.075628 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f0f9c-4c26-47a2-b3fd-2826d008c5d7 admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:43.080451 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecf4ea-4433-4805-ba67-df341deb5102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:43.081114 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecf4ea-4433-4805-ba67-df341deb5102 admin admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.081433 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecf4ea-4433-4805-ba67-df341deb5102 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.081711 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecf4ea-4433-4805-ba67-df341deb5102 admin admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.082324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b7e32-5fc8-4cc9-a332-6551db5bb967 admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:43.082432 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecf4ea-4433-4805-ba67-df341deb5102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:43.084422 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecf4ea-4433-4805-ba67-df341deb5102 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.086916 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70608edc-8c63-413f-bcd7-d5dcae2044dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:43.087571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70608edc-8c63-413f-bcd7-d5dcae2044dd admin admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.087855 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70608edc-8c63-413f-bcd7-d5dcae2044dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.088134 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70608edc-8c63-413f-bcd7-d5dcae2044dd admin admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.088810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70608edc-8c63-413f-bcd7-d5dcae2044dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:43.089858 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: WARNING py.warnings [None req-70608edc-8c63-413f-bcd7-d5dcae2044dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:53:43.089858 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: warnings.warn(msg) Jul 12 18:53:43.089858 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: Jul 12 18:53:43.091040 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70608edc-8c63-413f-bcd7-d5dcae2044dd admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.104861 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 576/1165] 10.222.0.16 () {60 vars in 1143 bytes} [Tue Jul 12 18:53:43 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:53:43.108964 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecf4ea-4433-4805-ba67-df341deb5102 admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:43.119433 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 590/1166] 10.222.0.16 () {60 vars in 1143 bytes} [Tue Jul 12 18:53:43 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:53:43.121057 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecf4ea-4433-4805-ba67-df341deb5102 admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:43.125177 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70608edc-8c63-413f-bcd7-d5dcae2044dd admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:43.127301 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1519a-fd4c-4801-95ae-56e7f3ef2d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:43.128024 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1519a-fd4c-4801-95ae-56e7f3ef2d6b admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.128305 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1519a-fd4c-4801-95ae-56e7f3ef2d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.128773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1519a-fd4c-4801-95ae-56e7f3ef2d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.129344 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1519a-fd4c-4801-95ae-56e7f3ef2d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:43.131000 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1519a-fd4c-4801-95ae-56e7f3ef2d6b admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.140091 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70608edc-8c63-413f-bcd7-d5dcae2044dd admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:43.144747 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 577/1167] 10.222.0.16 () {58 vars in 1121 bytes} [Tue Jul 12 18:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:53:43.144959 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe62a3-37a1-48bf-83ab-fa85f1f33872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:43.145518 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe62a3-37a1-48bf-83ab-fa85f1f33872 admin admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.145801 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe62a3-37a1-48bf-83ab-fa85f1f33872 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.146078 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe62a3-37a1-48bf-83ab-fa85f1f33872 admin admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.146789 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe62a3-37a1-48bf-83ab-fa85f1f33872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:43.148371 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe62a3-37a1-48bf-83ab-fa85f1f33872 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.148786 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1519a-fd4c-4801-95ae-56e7f3ef2d6b admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:43.158658 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1519a-fd4c-4801-95ae-56e7f3ef2d6b admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:43.158828 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 591/1168] 10.222.0.16 () {58 vars in 1121 bytes} [Tue Jul 12 18:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:53:43.162611 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe62a3-37a1-48bf-83ab-fa85f1f33872 admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:43.163514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50956b46-0267-406d-8d6c-6e4c498a357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:43.164202 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50956b46-0267-406d-8d6c-6e4c498a357c admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.164484 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50956b46-0267-406d-8d6c-6e4c498a357c admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.164759 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50956b46-0267-406d-8d6c-6e4c498a357c admin admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.165506 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50956b46-0267-406d-8d6c-6e4c498a357c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:43.167087 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50956b46-0267-406d-8d6c-6e4c498a357c admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.172134 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe62a3-37a1-48bf-83ab-fa85f1f33872 admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:43.177834 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e819bd-90b9-41ed-9298-dc417500f769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:43.178489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e819bd-90b9-41ed-9298-dc417500f769 admin admin] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.178775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e819bd-90b9-41ed-9298-dc417500f769 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.178921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 578/1169] 10.222.0.16 () {58 vars in 1121 bytes} [Tue Jul 12 18:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:53:43.179057 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e819bd-90b9-41ed-9298-dc417500f769 admin admin] PATH_INFO: `/v3/roles` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.179771 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e819bd-90b9-41ed-9298-dc417500f769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:43.181406 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e819bd-90b9-41ed-9298-dc417500f769 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.182767 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50956b46-0267-406d-8d6c-6e4c498a357c admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:43.192414 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 592/1170] 10.222.0.16 () {58 vars in 1121 bytes} [Tue Jul 12 18:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:53:43.192934 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50956b46-0267-406d-8d6c-6e4c498a357c admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:43.196348 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e819bd-90b9-41ed-9298-dc417500f769 admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:43.197592 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d0201-801a-4768-ac05-a752adaaf6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:43.198490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d0201-801a-4768-ac05-a752adaaf6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.198765 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d0201-801a-4768-ac05-a752adaaf6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.199035 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d0201-801a-4768-ac05-a752adaaf6f1 admin admin] PATH_INFO: `/v3/projects/9670add8df7b4259be9057f1c03e4844/users/1ff66c8e9a2f475d93d51853d3741b12/roles/a6f65f08e2fc407cad745e9cd18f282d` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.206242 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e819bd-90b9-41ed-9298-dc417500f769 admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:43.210918 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce98dc-c779-4424-acf0-8527466eea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:43.211768 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce98dc-c779-4424-acf0-8527466eea4f admin admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.212045 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce98dc-c779-4424-acf0-8527466eea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.212319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce98dc-c779-4424-acf0-8527466eea4f admin admin] PATH_INFO: `/v3/projects/8a907bbb7f31403194eca94f09b0af2e/users/6bc747f55a924481b54d49bab2de65ff/roles/a6f65f08e2fc407cad745e9cd18f282d` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.213830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d0201-801a-4768-ac05-a752adaaf6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9670add8df7b4259be9057f1c03e4844, user_id=1ff66c8e9a2f475d93d51853d3741b12, role_id=a6f65f08e2fc407cad745e9cd18f282d)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:43.214887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WARNING py.warnings [None req-eb4d0201-801a-4768-ac05-a752adaaf6f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:53:43.214887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: warnings.warn(msg) Jul 12 18:53:43.214887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: Jul 12 18:53:43.216827 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d0201-801a-4768-ac05-a752adaaf6f1 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.227051 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce98dc-c779-4424-acf0-8527466eea4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a907bbb7f31403194eca94f09b0af2e, user_id=6bc747f55a924481b54d49bab2de65ff, role_id=a6f65f08e2fc407cad745e9cd18f282d)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:43.229710 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce98dc-c779-4424-acf0-8527466eea4f admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.230993 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 579/1171] 10.222.0.16 () {60 vars in 1482 bytes} [Tue Jul 12 18:53:43 2022] PUT /identity/v3/projects/9670add8df7b4259be9057f1c03e4844/users/1ff66c8e9a2f475d93d51853d3741b12/roles/a6f65f08e2fc407cad745e9cd18f282d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:53:43.237085 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac95976-ea2b-4fd0-b44b-1fb9def5b430 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.237505 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac95976-ea2b-4fd0-b44b-1fb9def5b430 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.237795 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac95976-ea2b-4fd0-b44b-1fb9def5b430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.243520 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 593/1172] 10.222.0.16 () {60 vars in 1482 bytes} [Tue Jul 12 18:53:43 2022] PUT /identity/v3/projects/8a907bbb7f31403194eca94f09b0af2e/users/6bc747f55a924481b54d49bab2de65ff/roles/a6f65f08e2fc407cad745e9cd18f282d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:53:43.248662 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cff59-d81c-48c3-aa6c-02a4c4448f47 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.248953 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cff59-d81c-48c3-aa6c-02a4c4448f47 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.249235 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cff59-d81c-48c3-aa6c-02a4c4448f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.257762 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-aac95976-ea2b-4fd0-b44b-1fb9def5b430 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:53:43.258978 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-aac95976-ea2b-4fd0-b44b-1fb9def5b430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:43.266753 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-441cff59-d81c-48c3-aa6c-02a4c4448f47 None None] MFA Rules not processed for user `ca16bce227ff43aa8e414592d2c86bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:53:43.268529 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-441cff59-d81c-48c3-aa6c-02a4c4448f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:43.298971 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:43.309581 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:43.320590 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 580/1173] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:53:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:53:43.329114 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 594/1174] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:53:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:53:43.330486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac95976-ea2b-4fd0-b44b-1fb9def5b430 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:43.338309 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cff59-d81c-48c3-aa6c-02a4c4448f47 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:43.386701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac95976-ea2b-4fd0-b44b-1fb9def5b430 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:43.390252 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c954932-a9ba-40c3-8e28-5b3128c91fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:43.390893 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954932-a9ba-40c3-8e28-5b3128c91fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.391178 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954932-a9ba-40c3-8e28-5b3128c91fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.391454 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c954932-a9ba-40c3-8e28-5b3128c91fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.396979 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cff59-d81c-48c3-aa6c-02a4c4448f47 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:43.400367 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954932-a9ba-40c3-8e28-5b3128c91fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:43.400775 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c561a-a09b-4222-9996-8adcd0d7a4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:43.401510 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c561a-a09b-4222-9996-8adcd0d7a4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:43.401836 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c954932-a9ba-40c3-8e28-5b3128c91fa3 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.401970 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c561a-a09b-4222-9996-8adcd0d7a4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:43.402248 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c561a-a09b-4222-9996-8adcd0d7a4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:43.411591 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 581/1175] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:53:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:53:43.412541 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c561a-a09b-4222-9996-8adcd0d7a4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:43.413998 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c561a-a09b-4222-9996-8adcd0d7a4a6 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:43.424641 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 595/1176] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:53:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:53:48.962636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b84ddd-e5bf-474a-bf49-82632b0a0524 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:48.965633 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b84ddd-e5bf-474a-bf49-82632b0a0524 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:48.966603 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b84ddd-e5bf-474a-bf49-82632b0a0524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.013639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-57b84ddd-e5bf-474a-bf49-82632b0a0524 None None] MFA Rules not processed for user `6bc747f55a924481b54d49bab2de65ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:53:49.017528 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-57b84ddd-e5bf-474a-bf49-82632b0a0524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:49.140677 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 582/1177] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:53:48 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:53:49.146217 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c561a-a09b-4222-9996-8adcd0d7a4a6 service neutron] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.160001 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c561a-a09b-4222-9996-8adcd0d7a4a6 service neutron] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:49.168141 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3247d7-2d05-45eb-ac89-b1a2e27bb30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:49.169478 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3247d7-2d05-45eb-ac89-b1a2e27bb30e admin admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.169928 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3247d7-2d05-45eb-ac89-b1a2e27bb30e admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.170391 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3247d7-2d05-45eb-ac89-b1a2e27bb30e admin admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.171994 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3247d7-2d05-45eb-ac89-b1a2e27bb30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:49.174621 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3247d7-2d05-45eb-ac89-b1a2e27bb30e admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:49.224695 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 596/1178] 10.222.0.16 () {60 vars in 1152 bytes} [Tue Jul 12 18:53:49 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:53:49.225384 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b84ddd-e5bf-474a-bf49-82632b0a0524 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.239727 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b84ddd-e5bf-474a-bf49-82632b0a0524 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:49.330299 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46221748-498f-42a6-8fd6-37a7bade6813 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.330611 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46221748-498f-42a6-8fd6-37a7bade6813 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.330864 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46221748-498f-42a6-8fd6-37a7bade6813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.337769 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631fdc0-242c-4038-ae0e-22735c139576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:49.338642 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631fdc0-242c-4038-ae0e-22735c139576 admin admin] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.339004 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631fdc0-242c-4038-ae0e-22735c139576 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.339282 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631fdc0-242c-4038-ae0e-22735c139576 admin admin] PATH_INFO: `/v3/users` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.340041 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631fdc0-242c-4038-ae0e-22735c139576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:49.342433 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631fdc0-242c-4038-ae0e-22735c139576 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:49.367517 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-46221748-498f-42a6-8fd6-37a7bade6813 None None] MFA Rules not processed for user `1ff66c8e9a2f475d93d51853d3741b12`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:53:49.370147 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-46221748-498f-42a6-8fd6-37a7bade6813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:49.372495 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 583/1179] 10.222.0.16 () {60 vars in 1143 bytes} [Tue Jul 12 18:53:49 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:53:49.375964 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631fdc0-242c-4038-ae0e-22735c139576 admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.390267 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631fdc0-242c-4038-ae0e-22735c139576 admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:49.396295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feb87b-c9ff-4170-b8bd-dfec2a361f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:49.397439 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feb87b-c9ff-4170-b8bd-dfec2a361f02 admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.398083 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feb87b-c9ff-4170-b8bd-dfec2a361f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.398750 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08feb87b-c9ff-4170-b8bd-dfec2a361f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.399724 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08feb87b-c9ff-4170-b8bd-dfec2a361f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:49.402053 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08feb87b-c9ff-4170-b8bd-dfec2a361f02 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:49.405731 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:49.422576 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 584/1180] 10.222.0.16 () {58 vars in 1121 bytes} [Tue Jul 12 18:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:53:49.428045 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feb87b-c9ff-4170-b8bd-dfec2a361f02 admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.447305 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08feb87b-c9ff-4170-b8bd-dfec2a361f02 admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:49.452796 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ab11-4dfe-4455-9adc-7623324c2a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:49.453922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ab11-4dfe-4455-9adc-7623324c2a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.454900 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ab11-4dfe-4455-9adc-7623324c2a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.455183 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982ab11-4dfe-4455-9adc-7623324c2a65 admin admin] PATH_INFO: `/v3/projects/6dccac548f004d10b4f8c02b4bed937b/users/d990ada2a6a048ae8b68e7a08a3ed3f4/roles/948b82ff28c547e78755c196cddfdd0e` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.476225 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982ab11-4dfe-4455-9adc-7623324c2a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dccac548f004d10b4f8c02b4bed937b, user_id=d990ada2a6a048ae8b68e7a08a3ed3f4, role_id=948b82ff28c547e78755c196cddfdd0e)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:49.477063 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 597/1181] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:53:49 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:53:49.480037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982ab11-4dfe-4455-9adc-7623324c2a65 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:49.485713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46221748-498f-42a6-8fd6-37a7bade6813 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.499284 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46221748-498f-42a6-8fd6-37a7bade6813 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:49.499776 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 585/1182] 10.222.0.16 () {60 vars in 1482 bytes} [Tue Jul 12 18:53:49 2022] PUT /identity/v3/projects/6dccac548f004d10b4f8c02b4bed937b/users/d990ada2a6a048ae8b68e7a08a3ed3f4/roles/948b82ff28c547e78755c196cddfdd0e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:53:49.501372 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ab11-4dfe-4455-9adc-7623324c2a65 admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.580368 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982ab11-4dfe-4455-9adc-7623324c2a65 admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:49.582584 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:49.586240 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac50f6f-63d8-4076-a3d0-6063e2421f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:49.586964 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac50f6f-63d8-4076-a3d0-6063e2421f18 admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.587253 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac50f6f-63d8-4076-a3d0-6063e2421f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.587739 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac50f6f-63d8-4076-a3d0-6063e2421f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.588347 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac50f6f-63d8-4076-a3d0-6063e2421f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:49.590115 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac50f6f-63d8-4076-a3d0-6063e2421f18 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:49.595759 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd3cee-2da5-4e95-925e-e60955486954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:49.597788 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3cee-2da5-4e95-925e-e60955486954 admin admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.598817 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3cee-2da5-4e95-925e-e60955486954 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.601514 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd3cee-2da5-4e95-925e-e60955486954 admin admin] PATH_INFO: `/v3/projects` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.601708 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd3cee-2da5-4e95-925e-e60955486954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:49.602840 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 586/1183] 10.222.0.16 () {58 vars in 1121 bytes} [Tue Jul 12 18:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:53:49.607186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fd3cee-2da5-4e95-925e-e60955486954 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:49.607338 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac50f6f-63d8-4076-a3d0-6063e2421f18 admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.617830 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac50f6f-63d8-4076-a3d0-6063e2421f18 admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:49.623175 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289da89-0e67-4c4e-b6bd-38dd35a6e418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:49.624241 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289da89-0e67-4c4e-b6bd-38dd35a6e418 admin admin] REQUEST_METHOD: `PUT` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.624600 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289da89-0e67-4c4e-b6bd-38dd35a6e418 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.625114 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289da89-0e67-4c4e-b6bd-38dd35a6e418 admin admin] PATH_INFO: `/v3/projects/6dccac548f004d10b4f8c02b4bed937b/users/d990ada2a6a048ae8b68e7a08a3ed3f4/roles/948b82ff28c547e78755c196cddfdd0e` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.628071 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289da89-0e67-4c4e-b6bd-38dd35a6e418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dccac548f004d10b4f8c02b4bed937b, user_id=d990ada2a6a048ae8b68e7a08a3ed3f4, role_id=948b82ff28c547e78755c196cddfdd0e)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:49.630944 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289da89-0e67-4c4e-b6bd-38dd35a6e418 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:49.642678 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 598/1184] 10.222.0.16 () {60 vars in 1152 bytes} [Tue Jul 12 18:53:49 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:53:49.643563 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd3cee-2da5-4e95-925e-e60955486954 admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.649367 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 587/1185] 10.222.0.16 () {60 vars in 1482 bytes} [Tue Jul 12 18:53:49 2022] PUT /identity/v3/projects/6dccac548f004d10b4f8c02b4bed937b/users/d990ada2a6a048ae8b68e7a08a3ed3f4/roles/948b82ff28c547e78755c196cddfdd0e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:53:49.740883 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd3cee-2da5-4e95-925e-e60955486954 admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:49.747932 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2046a1-bfdb-43bb-9c6a-855318c9e84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:49.748875 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2046a1-bfdb-43bb-9c6a-855318c9e84e admin admin] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.749390 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2046a1-bfdb-43bb-9c6a-855318c9e84e admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.749875 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2046a1-bfdb-43bb-9c6a-855318c9e84e admin admin] PATH_INFO: `/v3/users` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.752538 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2046a1-bfdb-43bb-9c6a-855318c9e84e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:49.755678 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2046a1-bfdb-43bb-9c6a-855318c9e84e admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:49.792961 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 599/1186] 10.222.0.16 () {60 vars in 1143 bytes} [Tue Jul 12 18:53:49 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:53:49.796079 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289da89-0e67-4c4e-b6bd-38dd35a6e418 admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.892564 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289da89-0e67-4c4e-b6bd-38dd35a6e418 admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:49.897724 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b848b8-efde-4f65-b698-3e0679eddad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:49.898505 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b848b8-efde-4f65-b698-3e0679eddad4 admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.898886 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b848b8-efde-4f65-b698-3e0679eddad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.899259 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b848b8-efde-4f65-b698-3e0679eddad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.900132 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b848b8-efde-4f65-b698-3e0679eddad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:49.901859 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b848b8-efde-4f65-b698-3e0679eddad4 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:49.913957 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 588/1187] 10.222.0.16 () {58 vars in 1121 bytes} [Tue Jul 12 18:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:53:49.917755 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2046a1-bfdb-43bb-9c6a-855318c9e84e admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.929949 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2046a1-bfdb-43bb-9c6a-855318c9e84e admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:49.937392 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39073a-df81-47a7-a7f2-9bc6c7a53947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:49.938498 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39073a-df81-47a7-a7f2-9bc6c7a53947 admin admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:49.938879 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39073a-df81-47a7-a7f2-9bc6c7a53947 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:49.939278 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39073a-df81-47a7-a7f2-9bc6c7a53947 admin admin] PATH_INFO: `/v3/projects/b86d99c26ed343fda6227cc1d224767f/users/06a5c245f32c41869648515d71041748/roles/948b82ff28c547e78755c196cddfdd0e` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:49.955536 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39073a-df81-47a7-a7f2-9bc6c7a53947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86d99c26ed343fda6227cc1d224767f, user_id=06a5c245f32c41869648515d71041748, role_id=948b82ff28c547e78755c196cddfdd0e)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:49.958410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39073a-df81-47a7-a7f2-9bc6c7a53947 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:49.976119 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 600/1188] 10.222.0.16 () {60 vars in 1482 bytes} [Tue Jul 12 18:53:49 2022] PUT /identity/v3/projects/b86d99c26ed343fda6227cc1d224767f/users/06a5c245f32c41869648515d71041748/roles/948b82ff28c547e78755c196cddfdd0e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:53:49.980132 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b848b8-efde-4f65-b698-3e0679eddad4 admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:49.992028 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b848b8-efde-4f65-b698-3e0679eddad4 admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:50.125845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:50.149358 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acc53d-bd62-4b95-89a0-c3da827d5000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:50.150249 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acc53d-bd62-4b95-89a0-c3da827d5000 admin admin] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:50.150632 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acc53d-bd62-4b95-89a0-c3da827d5000 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:50.151008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acc53d-bd62-4b95-89a0-c3da827d5000 admin admin] PATH_INFO: `/v3/roles` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:50.151899 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acc53d-bd62-4b95-89a0-c3da827d5000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:50.155110 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acc53d-bd62-4b95-89a0-c3da827d5000 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:50.170104 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 589/1189] 10.222.0.16 () {58 vars in 1121 bytes} [Tue Jul 12 18:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:53:50.173163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39073a-df81-47a7-a7f2-9bc6c7a53947 admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:50.190120 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39073a-df81-47a7-a7f2-9bc6c7a53947 admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:50.197744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5982f2b-f93a-4928-a78f-53e77d032583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:50.198802 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5982f2b-f93a-4928-a78f-53e77d032583 admin admin] REQUEST_METHOD: `PUT` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:50.199186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5982f2b-f93a-4928-a78f-53e77d032583 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:50.199583 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5982f2b-f93a-4928-a78f-53e77d032583 admin admin] PATH_INFO: `/v3/projects/b86d99c26ed343fda6227cc1d224767f/users/06a5c245f32c41869648515d71041748/roles/948b82ff28c547e78755c196cddfdd0e` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:50.201853 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5982f2b-f93a-4928-a78f-53e77d032583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b86d99c26ed343fda6227cc1d224767f, user_id=06a5c245f32c41869648515d71041748, role_id=948b82ff28c547e78755c196cddfdd0e)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:50.206302 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5982f2b-f93a-4928-a78f-53e77d032583 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:50.221663 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 601/1190] 10.222.0.16 () {60 vars in 1482 bytes} [Tue Jul 12 18:53:50 2022] PUT /identity/v3/projects/b86d99c26ed343fda6227cc1d224767f/users/06a5c245f32c41869648515d71041748/roles/948b82ff28c547e78755c196cddfdd0e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:53:56.154814 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd4c5-25d2-4db4-a41d-0f1d06600ac1 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:56.155290 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd4c5-25d2-4db4-a41d-0f1d06600ac1 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:56.155380 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dd4c5-25d2-4db4-a41d-0f1d06600ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:56.191685 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-f63dd4c5-25d2-4db4-a41d-0f1d06600ac1 None None] MFA Rules not processed for user `d990ada2a6a048ae8b68e7a08a3ed3f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:53:56.192910 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-f63dd4c5-25d2-4db4-a41d-0f1d06600ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:56.317535 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 590/1191] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:53:56 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:53:56.326242 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5982f2b-f93a-4928-a78f-53e77d032583 admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:56.328131 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-c5982f2b-f93a-4928-a78f-53e77d032583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:56.447052 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5982f2b-f93a-4928-a78f-53e77d032583 admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:56.456138 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986e16c-3df5-4dec-ad9c-f290aee96e33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c0b548be2d4948bca2817337fdee5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:56.456820 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e16c-3df5-4dec-ad9c-f290aee96e33 service glance] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:56.457102 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e16c-3df5-4dec-ad9c-f290aee96e33 service glance] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:56.457405 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986e16c-3df5-4dec-ad9c-f290aee96e33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:56.540420 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:56.580766 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986e16c-3df5-4dec-ad9c-f290aee96e33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:56.582799 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986e16c-3df5-4dec-ad9c-f290aee96e33 service glance] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:56.596672 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 602/1192] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:53:56 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:53:56.844151 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd9625-afe4-4392-90af-aca104a90255 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:56.844151 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd9625-afe4-4392-90af-aca104a90255 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:56.844151 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd9625-afe4-4392-90af-aca104a90255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:56.898791 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-5ddd9625-afe4-4392-90af-aca104a90255 None None] MFA Rules not processed for user `06a5c245f32c41869648515d71041748`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:53:56.900205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-5ddd9625-afe4-4392-90af-aca104a90255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:53:57.076104 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 591/1193] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:53:56 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:53:57.085646 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986e16c-3df5-4dec-ad9c-f290aee96e33 service glance] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:53:57.103394 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986e16c-3df5-4dec-ad9c-f290aee96e33 service glance] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:53:57.108419 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc550c8-e40b-4d19-b48d-dc238e5d8b3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c0b548be2d4948bca2817337fdee5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:53:57.109459 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc550c8-e40b-4d19-b48d-dc238e5d8b3e service glance] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:53:57.109912 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc550c8-e40b-4d19-b48d-dc238e5d8b3e service glance] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:53:57.110428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc550c8-e40b-4d19-b48d-dc238e5d8b3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:53:57.257664 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc550c8-e40b-4d19-b48d-dc238e5d8b3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:53:57.259307 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc550c8-e40b-4d19-b48d-dc238e5d8b3e service glance] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:53:57.285989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 603/1194] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:53:57 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:54:04.892592 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43efddb-b746-47a5-8471-60268c7d4811 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:04.892592 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43efddb-b746-47a5-8471-60268c7d4811 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:04.893109 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43efddb-b746-47a5-8471-60268c7d4811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:04.911846 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-f43efddb-b746-47a5-8471-60268c7d4811 None None] MFA Rules not processed for user `6bc747f55a924481b54d49bab2de65ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:04.913246 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-f43efddb-b746-47a5-8471-60268c7d4811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:04.921452 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 592/1195] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:54:04 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:05.225054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3e3fe-31ca-452f-b591-b38b1d4c3501 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:05.225810 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3e3fe-31ca-452f-b591-b38b1d4c3501 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:05.226244 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3e3fe-31ca-452f-b591-b38b1d4c3501 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:05.230281 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 604/1196] 10.222.0.16 () {54 vars in 961 bytes} [Tue Jul 12 18:54:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:54:05.236732 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d0b4-7769-4104-bc71-6a2ef1976b63 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:05.237026 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d0b4-7769-4104-bc71-6a2ef1976b63 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:05.237339 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4d0b4-7769-4104-bc71-6a2ef1976b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:05.268246 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-47b4d0b4-7769-4104-bc71-6a2ef1976b63 None None] MFA Rules not processed for user `72918f9adc4240d99640b419e013b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:05.269561 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-47b4d0b4-7769-4104-bc71-6a2ef1976b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:05.309801 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=100 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:05.339225 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 593/1197] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Jul 12 18:54:05 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:05.344925 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c733058-752f-4036-a6a9-23d5ee1a6f1a None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:05.345316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c733058-752f-4036-a6a9-23d5ee1a6f1a None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:05.345675 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c733058-752f-4036-a6a9-23d5ee1a6f1a None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:05.347031 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 605/1198] 10.222.0.16 () {54 vars in 912 bytes} [Tue Jul 12 18:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:54:05.352031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe233-1d72-4d7b-96ea-40bb262a5a89 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:05.352329 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe233-1d72-4d7b-96ea-40bb262a5a89 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:05.352616 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fe233-1d72-4d7b-96ea-40bb262a5a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:05.370349 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-406fe233-1d72-4d7b-96ea-40bb262a5a89 None None] MFA Rules not processed for user `72918f9adc4240d99640b419e013b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:05.371551 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-406fe233-1d72-4d7b-96ea-40bb262a5a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:05.380526 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 594/1199] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Jul 12 18:54:05 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:05.393323 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c733058-752f-4036-a6a9-23d5ee1a6f1a None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:54:05.395078 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-8c733058-752f-4036-a6a9-23d5ee1a6f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:05.408288 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c733058-752f-4036-a6a9-23d5ee1a6f1a None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:54:05.412148 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412af06e-eb48-4f39-8f70-cbc87ecc894a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c0b548be2d4948bca2817337fdee5f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:54:05.412796 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412af06e-eb48-4f39-8f70-cbc87ecc894a service glance] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:05.413080 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412af06e-eb48-4f39-8f70-cbc87ecc894a service glance] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:05.413397 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412af06e-eb48-4f39-8f70-cbc87ecc894a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:05.424067 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412af06e-eb48-4f39-8f70-cbc87ecc894a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:54:05.425824 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412af06e-eb48-4f39-8f70-cbc87ecc894a service glance] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:54:05.436024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 606/1200] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:54:05 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:54:05.777623 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49ea56-718b-4007-b71d-da439d47e9d6 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:05.777913 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49ea56-718b-4007-b71d-da439d47e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:05.778194 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49ea56-718b-4007-b71d-da439d47e9d6 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:05.779658 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 595/1201] 10.222.0.16 () {54 vars in 912 bytes} [Tue Jul 12 18:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:54:05.785024 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4877-96c6-4756-ae3b-3880e19d9cd8 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:05.785352 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4877-96c6-4756-ae3b-3880e19d9cd8 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:05.785636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee4877-96c6-4756-ae3b-3880e19d9cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:05.816319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-f1ee4877-96c6-4756-ae3b-3880e19d9cd8 None None] MFA Rules not processed for user `b296e5ba36b243009b5fcfe708506c00`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:05.817533 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-f1ee4877-96c6-4756-ae3b-3880e19d9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:05.873350 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 607/1202] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Jul 12 18:54:05 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:05.887302 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49ea56-718b-4007-b71d-da439d47e9d6 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:54:05.899158 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49ea56-718b-4007-b71d-da439d47e9d6 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:54:05.904816 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b4658-1ab8-4378-a33b-cc883873608a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:54:05.905480 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4658-1ab8-4378-a33b-cc883873608a service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:05.905763 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4658-1ab8-4378-a33b-cc883873608a service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:05.906157 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b4658-1ab8-4378-a33b-cc883873608a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:05.913920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b4658-1ab8-4378-a33b-cc883873608a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:54:05.915276 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780b4658-1ab8-4378-a33b-cc883873608a service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:54:05.923599 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 596/1203] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:54:05 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:54:06.312937 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b694c-7f56-4e42-ae45-1a09818979e2 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:06.313611 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b694c-7f56-4e42-ae45-1a09818979e2 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:06.313863 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b694c-7f56-4e42-ae45-1a09818979e2 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:06.315681 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 608/1204] 10.222.0.16 () {54 vars in 961 bytes} [Tue Jul 12 18:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:54:06.321798 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d586-d7bd-4e25-b768-b2ab88548321 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:06.322159 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d586-d7bd-4e25-b768-b2ab88548321 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:06.322640 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187d586-d7bd-4e25-b768-b2ab88548321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:06.346797 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-f187d586-d7bd-4e25-b768-b2ab88548321 None None] MFA Rules not processed for user `72918f9adc4240d99640b419e013b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:06.348213 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-f187d586-d7bd-4e25-b768-b2ab88548321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:06.356921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dc3b7-6941-41bf-9454-fbc463f1faf2 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:06.357374 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dc3b7-6941-41bf-9454-fbc463f1faf2 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:06.357726 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dc3b7-6941-41bf-9454-fbc463f1faf2 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:06.359983 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 609/1205] 10.222.0.16 () {54 vars in 960 bytes} [Tue Jul 12 18:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:54:06.360569 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 597/1206] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Jul 12 18:54:06 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:54:06.364721 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7b2f-cb00-41f3-8901-8eabc0d7925b None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:06.365004 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7b2f-cb00-41f3-8901-8eabc0d7925b None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:06.365438 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b7b2f-cb00-41f3-8901-8eabc0d7925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:06.366390 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b873-6212-4e10-89bc-a3d8018d2434 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:06.366971 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b873-6212-4e10-89bc-a3d8018d2434 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:06.367275 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947b873-6212-4e10-89bc-a3d8018d2434 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:06.368773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 598/1207] 10.222.0.16 () {54 vars in 912 bytes} [Tue Jul 12 18:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:54:06.373660 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e99788-4702-45de-9137-83aa8488a6b6 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:06.373949 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e99788-4702-45de-9137-83aa8488a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:06.374233 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e99788-4702-45de-9137-83aa8488a6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:06.385878 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-849b7b2f-cb00-41f3-8901-8eabc0d7925b None None] MFA Rules not processed for user `ce92f306929849f98a89e3dadb26cb37`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:06.386931 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-849b7b2f-cb00-41f3-8901-8eabc0d7925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:06.400865 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-56e99788-4702-45de-9137-83aa8488a6b6 None None] MFA Rules not processed for user `72918f9adc4240d99640b419e013b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:06.402189 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-56e99788-4702-45de-9137-83aa8488a6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:06.418161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 599/1208] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Jul 12 18:54:06 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:06.424508 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e99788-4702-45de-9137-83aa8488a6b6 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:54:06.440641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e99788-4702-45de-9137-83aa8488a6b6 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:54:06.444411 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89acbbc3-de20-4680-a897-d0a67836c710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:54:06.445053 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acbbc3-de20-4680-a897-d0a67836c710 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:06.445450 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acbbc3-de20-4680-a897-d0a67836c710 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:06.445729 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acbbc3-de20-4680-a897-d0a67836c710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:06.452571 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=100 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:06.456920 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acbbc3-de20-4680-a897-d0a67836c710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:54:06.458581 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89acbbc3-de20-4680-a897-d0a67836c710 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:54:06.469064 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 610/1209] 10.222.0.16 () {58 vars in 1057 bytes} [Tue Jul 12 18:54:06 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:06.470153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 600/1210] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:54:06 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:54:06.480247 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b7b2f-cb00-41f3-8901-8eabc0d7925b None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:54:06.490612 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b7b2f-cb00-41f3-8901-8eabc0d7925b None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:54:06.496187 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f2c8-50e3-4ecd-a283-4184281989ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce92f306929849f98a89e3dadb26cb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:54:06.496908 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f2c8-50e3-4ecd-a283-4184281989ae service placement] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:06.497259 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f2c8-50e3-4ecd-a283-4184281989ae service placement] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:06.497635 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5f2c8-50e3-4ecd-a283-4184281989ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:06.499435 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-1ec5f2c8-50e3-4ecd-a283-4184281989ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:06.513396 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5f2c8-50e3-4ecd-a283-4184281989ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:54:06.515161 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec5f2c8-50e3-4ecd-a283-4184281989ae service placement] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:54:06.528186 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 611/1211] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:54:06 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:54:16.465632 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=31 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:16.523017 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=7 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:17.348877 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317572b-72e3-46a2-b55c-bf7db2ab7b96 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:17.349173 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317572b-72e3-46a2-b55c-bf7db2ab7b96 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:17.349698 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317572b-72e3-46a2-b55c-bf7db2ab7b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:17.367817 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-9317572b-72e3-46a2-b55c-bf7db2ab7b96 None None] MFA Rules not processed for user `b296e5ba36b243009b5fcfe708506c00`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:17.369004 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-9317572b-72e3-46a2-b55c-bf7db2ab7b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:17.377808 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 601/1212] 10.222.0.64 () {58 vars in 1015 bytes} [Tue Jul 12 18:54:17 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:17.394851 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f2c8-50e3-4ecd-a283-4184281989ae service placement] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:54:17.396240 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-1ec5f2c8-50e3-4ecd-a283-4184281989ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:17.408404 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5f2c8-50e3-4ecd-a283-4184281989ae service placement] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:54:17.412169 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e94ea-626f-4183-9c82-1d7ad597ba86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:54:17.412845 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e94ea-626f-4183-9c82-1d7ad597ba86 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:17.413127 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e94ea-626f-4183-9c82-1d7ad597ba86 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:17.413436 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e94ea-626f-4183-9c82-1d7ad597ba86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:17.421342 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e94ea-626f-4183-9c82-1d7ad597ba86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:54:17.422816 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e94ea-626f-4183-9c82-1d7ad597ba86 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:54:17.431163 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 612/1213] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:54:17 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:54:18.228788 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66329cee-6422-4399-9892-f2c865b8f9f6 None None] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:18.229955 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66329cee-6422-4399-9892-f2c865b8f9f6 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:18.230465 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66329cee-6422-4399-9892-f2c865b8f9f6 None None] PATH_INFO: `/` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:18.232143 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 602/1214] 10.222.0.16 () {54 vars in 921 bytes} [Tue Jul 12 18:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:54:18.273964 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0206cc-697a-4632-b445-528c147cde95 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:18.275124 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0206cc-697a-4632-b445-528c147cde95 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:18.275663 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0206cc-697a-4632-b445-528c147cde95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:18.305914 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-8f0206cc-697a-4632-b445-528c147cde95 None None] MFA Rules not processed for user `72918f9adc4240d99640b419e013b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:18.308260 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-8f0206cc-697a-4632-b445-528c147cde95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:18.320602 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 613/1215] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Jul 12 18:54:18 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:18.338367 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66329cee-6422-4399-9892-f2c865b8f9f6 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:54:18.354444 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66329cee-6422-4399-9892-f2c865b8f9f6 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:54:18.360205 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453a8e7-a6f3-42c6-91af-a21aec37bbe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:54:18.360863 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a8e7-a6f3-42c6-91af-a21aec37bbe5 service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:18.361144 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a8e7-a6f3-42c6-91af-a21aec37bbe5 service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:18.361477 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453a8e7-a6f3-42c6-91af-a21aec37bbe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:18.371217 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a8e7-a6f3-42c6-91af-a21aec37bbe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:54:18.372773 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453a8e7-a6f3-42c6-91af-a21aec37bbe5 service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:54:18.382828 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 603/1216] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:54:18 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:54:25.311988 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a05e-947d-4edb-9749-c6e435cc2a4e None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:25.313056 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a05e-947d-4edb-9749-c6e435cc2a4e None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:25.313393 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6a05e-947d-4edb-9749-c6e435cc2a4e None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:25.314948 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 614/1217] 10.222.0.16 () {54 vars in 921 bytes} [Tue Jul 12 18:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:54:25.326775 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e231d9-09e6-45ad-af72-a1134034a8cc None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:25.327388 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e231d9-09e6-45ad-af72-a1134034a8cc None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:25.327388 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e231d9-09e6-45ad-af72-a1134034a8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:25.348366 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-37e231d9-09e6-45ad-af72-a1134034a8cc None None] MFA Rules not processed for user `72918f9adc4240d99640b419e013b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:25.349742 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-37e231d9-09e6-45ad-af72-a1134034a8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:25.360114 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 604/1218] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Jul 12 18:54:25 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:54:25.375999 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a05e-947d-4edb-9749-c6e435cc2a4e None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:54:25.391510 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6a05e-947d-4edb-9749-c6e435cc2a4e None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:54:25.403907 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266929e4-d693-4659-b316-b23ce6109883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:54:25.404560 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266929e4-d693-4659-b316-b23ce6109883 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:25.404846 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266929e4-d693-4659-b316-b23ce6109883 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:25.405126 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266929e4-d693-4659-b316-b23ce6109883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:25.414654 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266929e4-d693-4659-b316-b23ce6109883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:54:25.416219 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266929e4-d693-4659-b316-b23ce6109883 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:54:25.426591 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 615/1219] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:54:25 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:54:35.342565 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=12 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:35.422837 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=15 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:36.683568 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e231d9-09e6-45ad-af72-a1134034a8cc None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:54:36.693607 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e231d9-09e6-45ad-af72-a1134034a8cc None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:54:36.697123 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71445b32-69b6-48d5-b929-f4e5b2474358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:54:36.697799 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71445b32-69b6-48d5-b929-f4e5b2474358 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:36.698086 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71445b32-69b6-48d5-b929-f4e5b2474358 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:36.698379 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71445b32-69b6-48d5-b929-f4e5b2474358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:36.707843 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71445b32-69b6-48d5-b929-f4e5b2474358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:54:36.709361 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71445b32-69b6-48d5-b929-f4e5b2474358 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:54:36.718710 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 605/1220] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:54:36 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:54:40.666315 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e937-1756-4aba-a412-036cdad920c0 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:40.667309 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e937-1756-4aba-a412-036cdad920c0 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:40.667587 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860e937-1756-4aba-a412-036cdad920c0 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:40.668989 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 616/1221] 10.222.0.16 () {54 vars in 921 bytes} [Tue Jul 12 18:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:54:40.702804 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4235f84-9757-46f5-b721-144f1dafbffa None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:40.703431 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4235f84-9757-46f5-b721-144f1dafbffa None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:40.706286 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4235f84-9757-46f5-b721-144f1dafbffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:40.744478 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-f4235f84-9757-46f5-b721-144f1dafbffa None None] MFA Rules not processed for user `72918f9adc4240d99640b419e013b343`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:40.746664 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-f4235f84-9757-46f5-b721-144f1dafbffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:40.757133 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 606/1222] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Jul 12 18:54:40 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:40.771837 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e937-1756-4aba-a412-036cdad920c0 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:54:40.805746 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860e937-1756-4aba-a412-036cdad920c0 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:54:40.814686 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c042023-0ec9-4dc3-af07-6093ad2c87c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:54:40.816188 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c042023-0ec9-4dc3-af07-6093ad2c87c7 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:40.816642 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c042023-0ec9-4dc3-af07-6093ad2c87c7 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:40.817729 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c042023-0ec9-4dc3-af07-6093ad2c87c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:40.830935 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c042023-0ec9-4dc3-af07-6093ad2c87c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:54:40.832717 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c042023-0ec9-4dc3-af07-6093ad2c87c7 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:54:40.848199 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 617/1223] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:54:40 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:54:50.738584 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=9 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:50.840235 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=6 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:54.824144 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c3cd-0a1f-415b-8309-b14c9be5318d None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:54.824774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c3cd-0a1f-415b-8309-b14c9be5318d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:54.824774 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c3cd-0a1f-415b-8309-b14c9be5318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:54.844578 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-2382c3cd-0a1f-415b-8309-b14c9be5318d None None] MFA Rules not processed for user `1ff66c8e9a2f475d93d51853d3741b12`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:54.845890 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-2382c3cd-0a1f-415b-8309-b14c9be5318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:54.852876 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 607/1224] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:54:54 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:55.151614 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27b3f-3eca-4106-b4b2-d48f565ee841 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:55.152117 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27b3f-3eca-4106-b4b2-d48f565ee841 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:55.152233 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e27b3f-3eca-4106-b4b2-d48f565ee841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:55.169622 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-f7e27b3f-3eca-4106-b4b2-d48f565ee841 None None] MFA Rules not processed for user `b296e5ba36b243009b5fcfe708506c00`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:54:55.170739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-f7e27b3f-3eca-4106-b4b2-d48f565ee841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:54:55.177855 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 618/1225] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Jul 12 18:54:55 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:54:55.189341 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382c3cd-0a1f-415b-8309-b14c9be5318d None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:54:55.198494 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382c3cd-0a1f-415b-8309-b14c9be5318d None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:54:55.201967 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4930c0f-38c1-4948-bdcf-d8797b6b64a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:54:55.202598 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4930c0f-38c1-4948-bdcf-d8797b6b64a8 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:54:55.202880 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4930c0f-38c1-4948-bdcf-d8797b6b64a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:54:55.203157 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4930c0f-38c1-4948-bdcf-d8797b6b64a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:54:55.209971 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4930c0f-38c1-4948-bdcf-d8797b6b64a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:54:55.211390 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4930c0f-38c1-4948-bdcf-d8797b6b64a8 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:54:55.218951 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 608/1226] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:54:55 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:55:05.165018 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=3 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:05.215641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=9 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:18.631051 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744dbf5-9fe9-47a9-8415-969eb6f124d8 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:55:18.631497 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744dbf5-9fe9-47a9-8415-969eb6f124d8 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:55:18.631609 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744dbf5-9fe9-47a9-8415-969eb6f124d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:55:18.649213 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-2744dbf5-9fe9-47a9-8415-969eb6f124d8 None None] MFA Rules not processed for user `1ff66c8e9a2f475d93d51853d3741b12`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:55:18.650401 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-2744dbf5-9fe9-47a9-8415-969eb6f124d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:55:18.657002 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 619/1227] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:55:18 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:55:28.643669 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=3 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:31.077868 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f95d-898f-4653-8192-eb7d638894b8 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:55:31.078295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f95d-898f-4653-8192-eb7d638894b8 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:55:31.078423 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7f95d-898f-4653-8192-eb7d638894b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:55:31.095104 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-5bc7f95d-898f-4653-8192-eb7d638894b8 None None] MFA Rules not processed for user `1ff66c8e9a2f475d93d51853d3741b12`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:55:31.096279 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-5bc7f95d-898f-4653-8192-eb7d638894b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:55:31.102949 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 609/1228] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:55:31 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:55:41.090295 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:27.279501 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c50627-84fa-4d38-9319-591289772553 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:56:27.279985 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c50627-84fa-4d38-9319-591289772553 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:56:27.280073 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c50627-84fa-4d38-9319-591289772553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:56:27.297473 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-86c50627-84fa-4d38-9319-591289772553 None None] MFA Rules not processed for user `1ff66c8e9a2f475d93d51853d3741b12`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:56:27.298650 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-86c50627-84fa-4d38-9319-591289772553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:56:27.305847 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 620/1229] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:56:27 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:56:37.292033 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=3 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:37.767007 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7f95d-898f-4653-8192-eb7d638894b8 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:56:37.785887 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7f95d-898f-4653-8192-eb7d638894b8 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:56:37.789440 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535b262-3c18-44b0-9734-9379200be459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:56:37.790078 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535b262-3c18-44b0-9734-9379200be459 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:56:37.790363 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535b262-3c18-44b0-9734-9379200be459 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:56:37.790641 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535b262-3c18-44b0-9734-9379200be459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:56:37.799453 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535b262-3c18-44b0-9734-9379200be459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:56:37.800909 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535b262-3c18-44b0-9734-9379200be459 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:56:37.810636 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 610/1230] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:56:37 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:56:47.806464 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=10 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:07.389637 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c50627-84fa-4d38-9319-591289772553 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:57:07.412939 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c50627-84fa-4d38-9319-591289772553 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:57:07.418140 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df676fc0-6df7-4c94-9437-d7480d116166 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce92f306929849f98a89e3dadb26cb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:57:07.418781 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676fc0-6df7-4c94-9437-d7480d116166 service placement] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:57:07.419095 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676fc0-6df7-4c94-9437-d7480d116166 service placement] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:57:07.419368 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df676fc0-6df7-4c94-9437-d7480d116166 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:57:07.428206 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df676fc0-6df7-4c94-9437-d7480d116166 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:57:07.429803 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df676fc0-6df7-4c94-9437-d7480d116166 service placement] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:57:07.439375 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 621/1231] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:57:07 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:57:17.435440 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=10 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:27.935215 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243225-a1f9-4e97-99a0-f26fcd404e1a None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:58:27.935778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243225-a1f9-4e97-99a0-f26fcd404e1a None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:58:27.935778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb243225-a1f9-4e97-99a0-f26fcd404e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:58:27.955402 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-fb243225-a1f9-4e97-99a0-f26fcd404e1a None None] MFA Rules not processed for user `6bc747f55a924481b54d49bab2de65ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:58:27.956723 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-fb243225-a1f9-4e97-99a0-f26fcd404e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:58:27.965262 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 611/1232] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:58:27 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:58:37.949947 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=3 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:48.390664 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7b323-bfe6-42bd-b5f9-799cc349fc39 None None] REQUEST_METHOD: `POST` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:58:48.391254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7b323-bfe6-42bd-b5f9-799cc349fc39 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:58:48.391254 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7b323-bfe6-42bd-b5f9-799cc349fc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:58:48.409638 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.auth.core [None req-79c7b323-bfe6-42bd-b5f9-799cc349fc39 None None] MFA Rules not processed for user `1ff66c8e9a2f475d93d51853d3741b12`. Rule list: `[]` (Enabled: `True`). {{(pid=93675) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:58:48.410940 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-79c7b323-bfe6-42bd-b5f9-799cc349fc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:58:48.418023 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 622/1233] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 18:58:48 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:58:57.982132 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb243225-a1f9-4e97-99a0-f26fcd404e1a None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:58:58.003118 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb243225-a1f9-4e97-99a0-f26fcd404e1a None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:58:58.007992 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c7bcc-20e2-4f3f-8903-09c5c96508d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:58:58.008623 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c7bcc-20e2-4f3f-8903-09c5c96508d6 service nova] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:58:58.008914 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c7bcc-20e2-4f3f-8903-09c5c96508d6 service nova] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:58:58.009187 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c7bcc-20e2-4f3f-8903-09c5c96508d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:58:58.017547 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c7bcc-20e2-4f3f-8903-09c5c96508d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:58:58.019146 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4c7bcc-20e2-4f3f-8903-09c5c96508d6 service nova] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:58:58.027653 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 612/1234] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:58:57 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:58:58.404218 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=3 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:08.023818 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=10 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:20.473220 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7b323-bfe6-42bd-b5f9-799cc349fc39 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:59:20.485157 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7b323-bfe6-42bd-b5f9-799cc349fc39 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:59:20.490124 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d2dd-b11b-45d1-85bc-8bfa550e0784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:59:20.490773 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d2dd-b11b-45d1-85bc-8bfa550e0784 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:59:20.491053 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d2dd-b11b-45d1-85bc-8bfa550e0784 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:59:20.491327 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9d2dd-b11b-45d1-85bc-8bfa550e0784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:59:20.499056 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9d2dd-b11b-45d1-85bc-8bfa550e0784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:59:20.500644 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9d2dd-b11b-45d1-85bc-8bfa550e0784 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:59:20.510049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 623/1235] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:59:20 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:59:20.658012 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c7bcc-20e2-4f3f-8903-09c5c96508d6 service nova] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:59:20.667469 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c7bcc-20e2-4f3f-8903-09c5c96508d6 service nova] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:59:20.671058 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbd7c7-fd41-4a05-9f21-ec0c2c5d114d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:59:20.671695 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbd7c7-fd41-4a05-9f21-ec0c2c5d114d service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:59:20.671978 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbd7c7-fd41-4a05-9f21-ec0c2c5d114d service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:59:20.672255 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbd7c7-fd41-4a05-9f21-ec0c2c5d114d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:59:20.674897 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d2dd-b11b-45d1-85bc-8bfa550e0784 service nova] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:59:20.682264 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbd7c7-fd41-4a05-9f21-ec0c2c5d114d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:59:20.683688 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbd7c7-fd41-4a05-9f21-ec0c2c5d114d service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:59:20.684319 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9d2dd-b11b-45d1-85bc-8bfa550e0784 service nova] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:59:20.688023 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd23a7-ace3-4300-8d61-90cac2494fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:59:20.688653 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd23a7-ace3-4300-8d61-90cac2494fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:59:20.688935 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd23a7-ace3-4300-8d61-90cac2494fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:59:20.689212 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd23a7-ace3-4300-8d61-90cac2494fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:59:20.693766 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 613/1236] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:59:20 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:59:20.696450 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd23a7-ace3-4300-8d61-90cac2494fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:59:20.697921 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd23a7-ace3-4300-8d61-90cac2494fe1 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:59:20.705962 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 624/1237] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:59:20 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:59:21.980271 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbd7c7-fd41-4a05-9f21-ec0c2c5d114d service neutron] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:59:21.989082 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbd7c7-fd41-4a05-9f21-ec0c2c5d114d service neutron] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:59:21.992867 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4f66-a6fa-4108-b680-4e57473f97ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:59:21.993571 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4f66-a6fa-4108-b680-4e57473f97ab service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:59:21.993856 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4f66-a6fa-4108-b680-4e57473f97ab service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:59:21.994130 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df4f66-a6fa-4108-b680-4e57473f97ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:59:22.003911 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df4f66-a6fa-4108-b680-4e57473f97ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:59:22.005510 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df4f66-a6fa-4108-b680-4e57473f97ab service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:59:22.015625 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 614/1238] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 18:59:21 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:59:30.702513 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=12 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:32.011124 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=12 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:10.466302 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd23a7-ace3-4300-8d61-90cac2494fe1 service neutron] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:00:10.486365 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd23a7-ace3-4300-8d61-90cac2494fe1 service neutron] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:00:10.493231 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbe296-0436-45c1-a44a-03f2ddcc397a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:00:10.494090 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbe296-0436-45c1-a44a-03f2ddcc397a service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:10.495027 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbe296-0436-45c1-a44a-03f2ddcc397a service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:10.495804 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbe296-0436-45c1-a44a-03f2ddcc397a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:10.510713 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbe296-0436-45c1-a44a-03f2ddcc397a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:00:10.512683 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbe296-0436-45c1-a44a-03f2ddcc397a service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:00:10.525747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 625/1239] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:00:10 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 19:00:18.503232 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4f66-a6fa-4108-b680-4e57473f97ab service neutron] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:00:18.511514 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df4f66-a6fa-4108-b680-4e57473f97ab service neutron] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:00:18.515643 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507aeffe-c333-48a2-8889-46d2746a1767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:00:18.516269 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507aeffe-c333-48a2-8889-46d2746a1767 service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:18.516548 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507aeffe-c333-48a2-8889-46d2746a1767 service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:18.516820 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507aeffe-c333-48a2-8889-46d2746a1767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:18.573811 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507aeffe-c333-48a2-8889-46d2746a1767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:00:18.575233 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507aeffe-c333-48a2-8889-46d2746a1767 service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:00:18.593370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 615/1240] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:00:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 19:00:20.521468 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=6 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:21.831054 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851504-c9f8-41a3-82b5-3b1c24c64879 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:21.832136 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851504-c9f8-41a3-82b5-3b1c24c64879 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:21.832569 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77851504-c9f8-41a3-82b5-3b1c24c64879 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:21.834428 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 626/1241] 10.222.0.16 () {54 vars in 921 bytes} [Tue Jul 12 19:00:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 19:00:21.844173 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12b171-6c83-492b-a8e7-26fb626a4544 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:21.845179 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12b171-6c83-492b-a8e7-26fb626a4544 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:21.845557 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12b171-6c83-492b-a8e7-26fb626a4544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:21.921322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-6c12b171-6c83-492b-a8e7-26fb626a4544 None None] MFA Rules not processed for user `ce92f306929849f98a89e3dadb26cb37`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 19:00:21.922571 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-6c12b171-6c83-492b-a8e7-26fb626a4544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:00:21.931461 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 616/1242] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Jul 12 19:00:21 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 19:00:21.965217 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77851504-c9f8-41a3-82b5-3b1c24c64879 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:00:21.980456 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77851504-c9f8-41a3-82b5-3b1c24c64879 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:00:21.993518 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fb5d0-ed7e-49d5-b67c-e4a1c0b5c9ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce92f306929849f98a89e3dadb26cb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:00:21.994797 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb5d0-ed7e-49d5-b67c-e4a1c0b5c9ee service placement] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:21.995081 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb5d0-ed7e-49d5-b67c-e4a1c0b5c9ee service placement] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:21.995358 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb5d0-ed7e-49d5-b67c-e4a1c0b5c9ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:22.005997 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fb5d0-ed7e-49d5-b67c-e4a1c0b5c9ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:00:22.009525 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620fb5d0-ed7e-49d5-b67c-e4a1c0b5c9ee service placement] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:00:22.021929 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 627/1243] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:00:21 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 19:00:25.065713 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12b171-6c83-492b-a8e7-26fb626a4544 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:00:25.081897 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12b171-6c83-492b-a8e7-26fb626a4544 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:00:25.093967 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:00:25.095022 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:25.095460 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:25.095738 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] PATH_INFO: `/v3/users/6bc747f55a924481b54d49bab2de65ff` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:25.096968 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bc747f55a924481b54d49bab2de65ff)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:00:25.098037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: WARNING py.warnings [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 19:00:25.098037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: warnings.warn(msg) Jul 12 19:00:25.098037 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: Jul 12 19:00:25.099261 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:00:25.167047 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bc747f55a924481b54d49bab2de65ff'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.186626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bc747f55a924481b54d49bab2de65ff'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.187309 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bc747f55a924481b54d49bab2de65ff'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.197486 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bc747f55a924481b54d49bab2de65ff'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.205551 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bc747f55a924481b54d49bab2de65ff'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.211508 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 617/1244] 10.222.0.16 () {58 vars in 1223 bytes} [Tue Jul 12 19:00:25 2022] DELETE /identity/v3/users/6bc747f55a924481b54d49bab2de65ff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 19:00:25.390841 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fb5d0-ed7e-49d5-b67c-e4a1c0b5c9ee service placement] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:00:25.402666 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fb5d0-ed7e-49d5-b67c-e4a1c0b5c9ee service placement] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:00:25.460739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:00:25.461707 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:25.461927 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:25.462197 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] PATH_INFO: `/v3/projects/8a907bbb7f31403194eca94f09b0af2e` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:25.463386 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a907bbb7f31403194eca94f09b0af2e)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:00:25.464385 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: WARNING py.warnings [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 19:00:25.464385 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: warnings.warn(msg) Jul 12 19:00:25.464385 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: Jul 12 19:00:25.465591 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:00:25.519276 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a907bbb7f31403194eca94f09b0af2e', 'request_id': 'req-58fde367-aa75-40a0-af9b-ab72c8857fb3'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.533039 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a907bbb7f31403194eca94f09b0af2e', 'request_id': 'req-58fde367-aa75-40a0-af9b-ab72c8857fb3'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.538840 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a907bbb7f31403194eca94f09b0af2e', 'request_id': 'req-58fde367-aa75-40a0-af9b-ab72c8857fb3'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.550410 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] The token cache is being invalidate because project 8a907bbb7f31403194eca94f09b0af2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 19:00:25.550696 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.551320 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.553047 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 628/1245] 10.222.0.16 () {58 vars in 1232 bytes} [Tue Jul 12 19:00:25 2022] DELETE /identity/v3/projects/8a907bbb7f31403194eca94f09b0af2e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 19:00:25.557061 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:00:25.558485 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:00:25.571564 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5b7c0-5498-4fd7-be4a-7cbbfa5f82cc admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:00:25.583582 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:25.628531 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:00:25.629458 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:25.629748 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:25.630031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] PATH_INFO: `/v3/users/d990ada2a6a048ae8b68e7a08a3ed3f4` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:25.631208 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d990ada2a6a048ae8b68e7a08a3ed3f4)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:00:25.633147 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:00:25.679164 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd990ada2a6a048ae8b68e7a08a3ed3f4'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.690813 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd990ada2a6a048ae8b68e7a08a3ed3f4'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.691471 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd990ada2a6a048ae8b68e7a08a3ed3f4'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.698370 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd990ada2a6a048ae8b68e7a08a3ed3f4'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.705996 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-bae4f3ad-6ea5-40ef-a951-84331aa9e1c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd990ada2a6a048ae8b68e7a08a3ed3f4'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:25.711676 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 618/1246] 10.222.0.16 () {58 vars in 1223 bytes} [Tue Jul 12 19:00:25 2022] DELETE /identity/v3/users/d990ada2a6a048ae8b68e7a08a3ed3f4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 19:00:25.892998 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:00:25.894491 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:00:25.907639 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fde367-aa75-40a0-af9b-ab72c8857fb3 admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:00:25.962733 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:00:25.963608 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:25.963933 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:25.964205 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] PATH_INFO: `/v3/projects/6dccac548f004d10b4f8c02b4bed937b` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:25.965460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dccac548f004d10b4f8c02b4bed937b)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:00:25.967789 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:00:25.988221 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:26.013132 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dccac548f004d10b4f8c02b4bed937b', 'request_id': 'req-486a5b2c-cf59-4c95-9541-0d15526ca4c2'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:26.019316 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dccac548f004d10b4f8c02b4bed937b', 'request_id': 'req-486a5b2c-cf59-4c95-9541-0d15526ca4c2'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:26.024747 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dccac548f004d10b4f8c02b4bed937b', 'request_id': 'req-486a5b2c-cf59-4c95-9541-0d15526ca4c2'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:26.037242 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] The token cache is being invalidate because project 6dccac548f004d10b4f8c02b4bed937b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 19:00:26.037565 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:26.038180 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:00:26.039714 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 629/1247] 10.222.0.16 () {58 vars in 1232 bytes} [Tue Jul 12 19:00:25 2022] DELETE /identity/v3/projects/6dccac548f004d10b4f8c02b4bed937b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 19:00:35.708375 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:36.034331 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:45.585200 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45444dc-af99-40da-a423-87bde742774d None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:45.585723 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45444dc-af99-40da-a423-87bde742774d None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:45.585821 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45444dc-af99-40da-a423-87bde742774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:45.602227 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-c45444dc-af99-40da-a423-87bde742774d None None] MFA Rules not processed for user `1ff66c8e9a2f475d93d51853d3741b12`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 19:00:45.603449 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-c45444dc-af99-40da-a423-87bde742774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:00:45.658161 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 619/1248] 10.222.0.16 () {58 vars in 957 bytes} [Tue Jul 12 19:00:45 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 19:00:45.975453 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:00:45.976857 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:00:46.031770 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a5b2c-cf59-4c95-9541-0d15526ca4c2 admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:00:46.035831 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aeb0b-6974-46c6-b9ea-e2c0bf0836a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:00:46.036462 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aeb0b-6974-46c6-b9ea-e2c0bf0836a7 service neutron] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:46.036742 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aeb0b-6974-46c6-b9ea-e2c0bf0836a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:46.037017 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aeb0b-6974-46c6-b9ea-e2c0bf0836a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:46.038739 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-371aeb0b-6974-46c6-b9ea-e2c0bf0836a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:00:46.047554 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aeb0b-6974-46c6-b9ea-e2c0bf0836a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:00:46.049636 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371aeb0b-6974-46c6-b9ea-e2c0bf0836a7 service neutron] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:00:46.057460 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 630/1249] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:00:45 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 19:00:46.500322 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45444dc-af99-40da-a423-87bde742774d None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:00:46.501943 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-c45444dc-af99-40da-a423-87bde742774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:00:46.570038 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45444dc-af99-40da-a423-87bde742774d None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:00:46.574997 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95f653-a9a7-479d-8082-a1e70958a683 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce92f306929849f98a89e3dadb26cb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:00:46.575666 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95f653-a9a7-479d-8082-a1e70958a683 service placement] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:46.575948 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95f653-a9a7-479d-8082-a1e70958a683 service placement] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:46.576227 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d95f653-a9a7-479d-8082-a1e70958a683 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:46.577954 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-4d95f653-a9a7-479d-8082-a1e70958a683 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:00:46.589455 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95f653-a9a7-479d-8082-a1e70958a683 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:00:46.591030 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d95f653-a9a7-479d-8082-a1e70958a683 service placement] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:00:46.601072 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 620/1250] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:00:46 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 19:00:55.133489 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aeb0b-6974-46c6-b9ea-e2c0bf0836a7 service neutron] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:00:55.134911 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-371aeb0b-6974-46c6-b9ea-e2c0bf0836a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:00:55.205272 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aeb0b-6974-46c6-b9ea-e2c0bf0836a7 service neutron] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:00:55.211933 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33e104-c0b9-47a4-9b80-251db882ff08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:00:55.213009 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33e104-c0b9-47a4-9b80-251db882ff08 service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:00:55.213477 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33e104-c0b9-47a4-9b80-251db882ff08 service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:00:55.213786 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33e104-c0b9-47a4-9b80-251db882ff08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:00:55.215631 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-0a33e104-c0b9-47a4-9b80-251db882ff08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:00:55.227915 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33e104-c0b9-47a4-9b80-251db882ff08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:00:55.229517 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a33e104-c0b9-47a4-9b80-251db882ff08 service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:00:55.239008 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 631/1251] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:00:55 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 19:00:56.597125 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=57 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:01:05.235093 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=58 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:12.859056 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95f653-a9a7-479d-8082-a1e70958a683 service placement] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:02:12.860490 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-4d95f653-a9a7-479d-8082-a1e70958a683 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:02:12.920908 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d95f653-a9a7-479d-8082-a1e70958a683 service placement] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:02:12.926778 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df4336-ac1f-43c3-aeba-a79b5d4ba260 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce92f306929849f98a89e3dadb26cb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:02:12.927412 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df4336-ac1f-43c3-aeba-a79b5d4ba260 service placement] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:02:12.927690 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df4336-ac1f-43c3-aeba-a79b5d4ba260 service placement] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:02:12.927966 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04df4336-ac1f-43c3-aeba-a79b5d4ba260 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:02:12.930031 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-04df4336-ac1f-43c3-aeba-a79b5d4ba260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:02:12.947502 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df4336-ac1f-43c3-aeba-a79b5d4ba260 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:02:12.949078 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04df4336-ac1f-43c3-aeba-a79b5d4ba260 service placement] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:02:12.958845 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 621/1252] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:02:12 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 19:02:22.954626 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=28 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:41.123681 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33e104-c0b9-47a4-9b80-251db882ff08 service nova] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:02:41.186596 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a33e104-c0b9-47a4-9b80-251db882ff08 service nova] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:02:41.192496 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f050126-8b55-4015-9623-0ef38f09d74f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72918f9adc4240d99640b419e013b343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:02:41.193324 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f050126-8b55-4015-9623-0ef38f09d74f service nova] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:02:41.193707 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f050126-8b55-4015-9623-0ef38f09d74f service nova] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:02:41.194033 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f050126-8b55-4015-9623-0ef38f09d74f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:02:41.196688 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-1f050126-8b55-4015-9623-0ef38f09d74f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:02:41.215819 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f050126-8b55-4015-9623-0ef38f09d74f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:02:41.217618 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f050126-8b55-4015-9623-0ef38f09d74f service nova] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:02:41.229058 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 632/1253] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:02:41 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 19:02:51.224670 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=20 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:03:25.185647 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df4336-ac1f-43c3-aeba-a79b5d4ba260 service placement] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:03:25.187047 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-04df4336-ac1f-43c3-aeba-a79b5d4ba260 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:03:25.198063 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04df4336-ac1f-43c3-aeba-a79b5d4ba260 service placement] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:03:25.201922 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02c4a-d354-4427-9645-01e02d3351dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b296e5ba36b243009b5fcfe708506c00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:03:25.202553 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02c4a-d354-4427-9645-01e02d3351dd service neutron] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:03:25.202832 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02c4a-d354-4427-9645-01e02d3351dd service neutron] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:03:25.203102 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02c4a-d354-4427-9645-01e02d3351dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:03:25.204758 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-c0b02c4a-d354-4427-9645-01e02d3351dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:03:25.287078 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b02c4a-d354-4427-9645-01e02d3351dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:03:25.288517 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b02c4a-d354-4427-9645-01e02d3351dd service neutron] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:03:25.298351 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 622/1254] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:03:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 19:03:28.391458 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c538-bfcd-4629-b339-d719b24a3bb6 None None] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:03:28.392031 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c538-bfcd-4629-b339-d719b24a3bb6 None None] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:03:28.392031 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c538-bfcd-4629-b339-d719b24a3bb6 None None] PATH_INFO: `/` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:03:28.393365 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 633/1255] 10.222.0.16 () {54 vars in 921 bytes} [Tue Jul 12 19:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 19:03:28.399877 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd86ac-834d-4686-a4a2-bff826c5b327 None None] REQUEST_METHOD: `POST` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:03:28.400296 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd86ac-834d-4686-a4a2-bff826c5b327 None None] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:03:28.400494 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd86ac-834d-4686-a4a2-bff826c5b327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:03:28.429746 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.auth.core [None req-b6bd86ac-834d-4686-a4a2-bff826c5b327 None None] MFA Rules not processed for user `ce92f306929849f98a89e3dadb26cb37`. Rule list: `[]` (Enabled: `True`). {{(pid=93676) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 19:03:28.431249 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-b6bd86ac-834d-4686-a4a2-bff826c5b327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:03:28.440008 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 623/1256] 10.222.0.16 () {58 vars in 1018 bytes} [Tue Jul 12 19:03:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 19:03:28.454576 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c538-bfcd-4629-b339-d719b24a3bb6 None None] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:03:28.469879 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c538-bfcd-4629-b339-d719b24a3bb6 None None] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:03:28.475365 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac78190-6e6f-46fe-b2e0-88bddc5d3e0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce92f306929849f98a89e3dadb26cb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:03:28.476237 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac78190-6e6f-46fe-b2e0-88bddc5d3e0e service placement] REQUEST_METHOD: `GET` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:03:28.476534 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac78190-6e6f-46fe-b2e0-88bddc5d3e0e service placement] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:03:28.477035 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac78190-6e6f-46fe-b2e0-88bddc5d3e0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:03:28.486985 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac78190-6e6f-46fe-b2e0-88bddc5d3e0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:03:28.488589 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac78190-6e6f-46fe-b2e0-88bddc5d3e0e service placement] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:03:28.498359 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 634/1257] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:03:28 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 19:03:31.543233 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd86ac-834d-4686-a4a2-bff826c5b327 None None] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:03:31.546110 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-b6bd86ac-834d-4686-a4a2-bff826c5b327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:03:31.563989 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd86ac-834d-4686-a4a2-bff826c5b327 None None] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:03:31.568978 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:03:31.570024 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:03:31.570509 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:03:31.570876 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] PATH_INFO: `/v3/users/1ff66c8e9a2f475d93d51853d3741b12` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:03:31.572153 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ff66c8e9a2f475d93d51853d3741b12)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:03:31.574229 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:03:31.624265 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ff66c8e9a2f475d93d51853d3741b12'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:31.636024 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ff66c8e9a2f475d93d51853d3741b12'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:31.636694 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ff66c8e9a2f475d93d51853d3741b12'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:31.643471 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ff66c8e9a2f475d93d51853d3741b12'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:31.651104 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ff66c8e9a2f475d93d51853d3741b12'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:31.658151 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 624/1258] 10.222.0.16 () {58 vars in 1223 bytes} [Tue Jul 12 19:03:31 2022] DELETE /identity/v3/users/1ff66c8e9a2f475d93d51853d3741b12 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 19:03:31.835202 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac78190-6e6f-46fe-b2e0-88bddc5d3e0e service placement] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:03:31.846860 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac78190-6e6f-46fe-b2e0-88bddc5d3e0e service placement] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:03:31.902667 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:03:31.904193 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:03:31.904470 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:03:31.904744 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] PATH_INFO: `/v3/projects/9670add8df7b4259be9057f1c03e4844` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:03:31.905933 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9670add8df7b4259be9057f1c03e4844)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:03:31.907827 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:03:31.954154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9670add8df7b4259be9057f1c03e4844', 'request_id': 'req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:31.960035 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9670add8df7b4259be9057f1c03e4844', 'request_id': 'req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:31.966175 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9670add8df7b4259be9057f1c03e4844', 'request_id': 'req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:31.977872 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] The token cache is being invalidate because project 9670add8df7b4259be9057f1c03e4844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 19:03:31.978154 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:31.978806 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:31.980385 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 635/1259] 10.222.0.16 () {58 vars in 1232 bytes} [Tue Jul 12 19:03:31 2022] DELETE /identity/v3/projects/9670add8df7b4259be9057f1c03e4844 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 19:03:31.984530 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:03:31.985953 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:03:31.998639 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc2a7f-b3b4-4ea8-9b6e-908da2f9cf36 admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:03:32.026825 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:03:32.055289 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:03:32.056158 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:03:32.056445 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:03:32.056725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] PATH_INFO: `/v3/users/06a5c245f32c41869648515d71041748` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:03:32.057921 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a5c245f32c41869648515d71041748)` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:03:32.060360 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:03:32.104638 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a5c245f32c41869648515d71041748'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:32.116530 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a5c245f32c41869648515d71041748'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:32.117245 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a5c245f32c41869648515d71041748'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:32.124720 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a5c245f32c41869648515d71041748'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:32.131690 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.notifications [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a5c245f32c41869648515d71041748'} {{(pid=93676) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:32.138466 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 625/1260] 10.222.0.16 () {58 vars in 1223 bytes} [Tue Jul 12 19:03:31 2022] DELETE /identity/v3/users/06a5c245f32c41869648515d71041748 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 19:03:32.302006 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] Authenticating user token {{(pid=93675) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:03:32.303445 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.fernet_utils [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93675) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:03:32.317043 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aff099-b244-44b4-b4b0-0aaaf77ad21b admin admin] Validating token access rules against request {{(pid=93675) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:03:32.372241 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca16bce227ff43aa8e414592d2c86bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '50ac8b5806ca4cab991abf52d2b9928f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93675) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:03:32.373036 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:03:32.373344 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:03:32.373626 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] PATH_INFO: `/v3/projects/b86d99c26ed343fda6227cc1d224767f` {{(pid=93675) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:03:32.374799 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b86d99c26ed343fda6227cc1d224767f)` {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:03:32.376774 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] RBAC: Authorization granted {{(pid=93675) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:03:32.399429 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:03:32.424830 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b86d99c26ed343fda6227cc1d224767f', 'request_id': 'req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:32.431143 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b86d99c26ed343fda6227cc1d224767f', 'request_id': 'req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:32.437049 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b86d99c26ed343fda6227cc1d224767f', 'request_id': 'req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae'} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:32.448642 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] The token cache is being invalidate because project b86d99c26ed343fda6227cc1d224767f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93675) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 19:03:32.448923 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:32.449592 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG keystone.notifications [None req-ade40a03-9c5f-48bd-ab98-c05ede7c69ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93675) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 19:03:32.451742 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: [pid: 93675|app: 0|req: 636/1261] 10.222.0.16 () {58 vars in 1232 bytes} [Tue Jul 12 19:03:32 2022] DELETE /identity/v3/projects/b86d99c26ed343fda6227cc1d224767f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 19:03:42.134382 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=39,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:03:42.445870 dv-osbrick-849026-1-ceph devstack@keystone.service[93675]: DEBUG dbcounter [-] [93675] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:07:17.247097 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] Authenticating user token {{(pid=93676) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 19:07:17.248701 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:07:17.328066 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094a508-021a-4da5-aef6-434da6be7cef admin admin] Validating token access rules against request {{(pid=93676) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 19:07:17.385725 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66b7ac-ca51-4aff-b223-2f9181d7dadb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce92f306929849f98a89e3dadb26cb37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ae279b6ea9b04682832e4f2aaf4f9a00', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93676) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 19:07:17.386376 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66b7ac-ca51-4aff-b223-2f9181d7dadb service placement] REQUEST_METHOD: `GET` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 19:07:17.386662 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66b7ac-ca51-4aff-b223-2f9181d7dadb service placement] SCRIPT_NAME: `/identity` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 19:07:17.386943 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66b7ac-ca51-4aff-b223-2f9181d7dadb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93676) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 19:07:17.388713 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.fernet_utils [None req-2a66b7ac-ca51-4aff-b223-2f9181d7dadb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93676) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 19:07:17.399389 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66b7ac-ca51-4aff-b223-2f9181d7dadb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 19:07:17.401555 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66b7ac-ca51-4aff-b223-2f9181d7dadb service placement] RBAC: Authorization granted {{(pid=93676) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 19:07:17.410960 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: [pid: 93676|app: 0|req: 626/1262] 10.222.0.16 () {60 vars in 1365 bytes} [Tue Jul 12 19:07:17 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 19:07:27.407034 dv-osbrick-849026-1-ceph devstack@keystone.service[93676]: DEBUG dbcounter [-] [93676] Writing DB stats keystone:SELECT=62 {{(pid=93676) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}